I am having hard time finding the application itself which i can deploy on the device, I installed arcgis for windows mobile on PC and i can create projects, anyone have a link to the out-of-the-box application for handheld devices?
Do you mean for data collection... which a mobile device would be designed for... can be found here
GeoCollector Series | GeoCollector for ArcGIS for Windows Mobile
ArcGIS for Windows Mobile is now fairly hidden away in My ESRI for download.
You can find it underneath ArcGIS Desktop and then 'Additional Products' where it's listed as "ArcGIS 10.2.1 for Windows Mobile (compatible with ArcGIS 10.3)". The SDK is there also if you need it.