topic Re: ESRI UC 2015 new UAV mapping application insights in ArcGIS Drone2Map Questions

ESRI UC 2015 new UAV mapping application insights

nita14 — Tue, 28 Jul 2015 06:52:42 GMT

Dear Esri Staff,

I have watched the UC Plenary Session proceeding about the new UAV mapping application. I have some questions regarding the functionality/plan for development.

1) What are the requirements for the UAV camera and GPS/INS system ?

2) What metadata is required to process still UAV images? Does it have to be FMV military standard?

3) Is the new application going to be integrated with Mosaic Dataset/ Image Service/ ArcGIS Desktop and ArcGIS Runtime?

4) Can I do the following with the new UAV mapping application?

- Create orthorectiefied image?

- Measure a height?

- Other functionalities?

5) According to the video, the point cloud can be produced from images. What is the output of the process? Is it LAS dataset? Is there any automatic algorithms for change detection and feature detection/others?

6) What are the time frames for the app release?

7) What about working with Harris in order to create fully-capable UAV data processing solution?

Thank you in advance for any news,

Adam

Re: ESRI UC 2015 new UAV mapping application insights

larryzhang — Thu, 30 Jul 2015 05:42:47 GMT

Just watch this UAS video at http://video.esri.com/watch/4652/unmanned-aerial-systems

It looks that ESRI has already obtained some solid progress on UAV mapping...

Great jobs, ESRI!

Personally, beyond the above questions by Adam, the following urgent IT implementations with Drone would be highly required:

directly support the Drone video in ArcGIS Pro & ArcGIS Online (Portal) as plug-in & widget; and later on
directly allow users to model 3D from 'spatially rectified' Drone video or still Drone images;

Re: ESRI UC 2015 new UAV mapping application insights

CodyBenkelman — Wed, 12 Aug 2015 01:38:40 GMT

The app for drone imagery is still under development, so some of this is not certain - but I will answer as best I can.

1)	What are the requirements for the UAV camera and GPS/INS system ? The app should work with imagery from nearly any drone, presuming you have GPS and adequate overlap between images. See below for further details
a.	GPS location information (via EXIF Headers or an external file that links each image to a GPS [x,y,z] value) is required to generate good results and efficient processing. Camera orientation metadata (from INS) is not required, but if it is available, it will improve both results and processing speed. Note if you have precise INS data that provides XYZ and Omega/Phi/Kappa for each image, you do not need the new app - you can use the Frame Camera raster type (in version 10.3.1) immediately
b.	camera metadata is also required (e.g. focal length & pixel size) but these values can be approximate – e.g. a metric camera model is not required as input. There are no other specific requirements on the camera.
c.	A high amount of image overlap (e.g. 80% or more both along flightlines and between flightlines) is recommended for best results. If overlap is lower, the accuracy of your output products will be reduced.
2)	What metadata is required to process still UAV images? Does it have to be FMV military standard?
a.	Metadata is listed above for still imagery. This application will not process video (in the first release), so the question of military standard FMV would not apply. If you have MISB formatted video, the free ArcGIS FMV plugin will allow that data to be ingested into ArcGIS Desktop. If you have video with GPS, but not full MISB metadata, see this post: https://community.esri.com/thread/120573

3)	Is the new application going to be integrated with Mosaic Dataset/ Image Service/ ArcGIS Desktop and ArcGIS Runtime?
a.	In the first release the new application will operate in a standalone mode, not directly interfaced into ArcGIS Desktop or Runtime. Future versions will increase integration. All outputs from the application will be compatible with ArcGIS, and recommended workflows (with example Python scripts) will be available for ingesting the output products (see below) into the Mosaic Dataset for efficient data management, and also for sharing via Image Services.
4)	Can I do the following with the new UAV mapping application?

- Create orthorectified image?

Yes, orthorectified imagery will be one of the outputs

- Measure a height?

Height measurements will be enabled via existing functionality within ArcGIS Desktop. The new application will be intended for processing UAV imagery for ingestion into ArcGIS, but will not have analytical capabilities within the application.

- Other functionalities?

See below

The output point cloud will be either LAS format or zLAS format. You will need ArcGIS Desktop to be able to create a LAS Dataset to reference these or any LAS or zLAS files.
As noted above, the new application will not include analysis capabilities – that functionality will remain in ArcGIS Desktop (ArcMap and ArcGIS Pro)

6) What are the time frames for the app release?

Release date is not certain at this time but the application is expected to be available late this year.

7) What about working with Harris in order to create fully-capable UAV data processing solution?

Esri encourages collaboration with all of our business partners, but partners typically develop their own applications to build onto the capabilities of the ArcGIS Platform. If you have requests for specific functionality, please let us know your requirements!

Drones, UAVs, UAS, and RPAs

Re: ESRI UC 2015 new UAV mapping application insights

IanBroad — Fri, 14 Aug 2015 16:17:24 GMT

Any idea on ballpark pricing? I assume probably not yet...

It will be interesting to see how ESRI's application compares with software such as Agisoft's PhotoScan and Pix4D's Pix4Dmapper.

Re: ESRI UC 2015 new UAV mapping application insights

nita14 — Mon, 17 Aug 2015 07:33:04 GMT

Hi Cody,

Thank you for your in-depth explanation! There is one thing missing: 5 c) Is there any automatic algorithms for change detection and feature detection/others?

Are you going to add 'follow' or 'feature moving detection' video stream analysis in the future release? I am looking forward for incorporating UAV capabilities or even better, FMV add-in into ArcGIS Runtime. This is valid feature for all ISR systems.

Regards,

Adam

Re: ESRI UC 2015 new UAV mapping application insights

CodyBenkelman — Mon, 17 Aug 2015 19:46:58 GMT

Adam

In the first release, the UAV mapping application (expected to be called "Drone2Map") will not include any analytical functionality. Future capabilities are not yet defined, but analytical capabilities (change detection / feature detection) will be part of the core ArcGIS Desktop tools.

Features of the FMV add-in are a separate development, but object tracking is not planned for inclusing in the FMV add-in (at least not in the next release). The next version of FMV will have the ability to multiplex separate video and GPS streams, which will facilitate management and use of video from UAV platforms.

Cody B

Re: ESRI UC 2015 new UAV mapping application insights

nita14 — Tue, 18 Aug 2015 05:33:17 GMT

Thank you Cody for the answers!

Regards,

Adam

Re: ESRI UC 2015 new UAV mapping application insights

DanAllen — Mon, 09 Nov 2015 17:52:04 GMT

Did anyone respond if the UAV processing will be a separately licensed product, or included in your desktop subscription at no additional cost?

Also, in Pix 4d you can add add ground control points visible in the images that were also shot with an RTK GPS. Will this feature be planned for the initial release of the ESRI UAV software app?

Re: ESRI UC 2015 new UAV mapping application insights

CodyBenkelman — Tue, 10 Nov 2015 06:07:14 GMT

Dan

The Drone2Map app will require a separate license, but final pricing has not been determined.

and Yes, users will be able to enter ground control points into the process

Cody B.

Re: ESRI UC 2015 new UAV mapping application insights

DanAllen — Tue, 10 Nov 2015 14:46:14 GMT

Thanks Cody. I guess if the Drone2Map software will be a licensed product, then I would set my expectations a little higher, and hope you can give us something similar/better, and much cheaper than the Pix4D software I see most people using for this workflow.

Re: ESRI UC 2015 new UAV mapping application insights

Ryan_Galbraith — Fri, 13 Nov 2015 17:51:11 GMT

Has there been any movement or information about this new app? Is it an add-on to ArcGIS Pro?

Re: ESRI UC 2015 new UAV mapping application insights

CodyBenkelman — Fri, 13 Nov 2015 17:56:34 GMT

Ryan

(As noted above) The initial release will be a standalone app, with increasing integration into the ArcGIS Platform in later releases.

Cody B

Re: ESRI UC 2015 new UAV mapping application insights

DanAllen — Fri, 13 Nov 2015 18:47:19 GMT

Will the Drone2Map app be part of the ESRI BETA testing program?

Dan

Re: ESRI UC 2015 new UAV mapping application insights

DanAllen — Wed, 30 Dec 2015 15:47:40 GMT

Any update on a potential release date and cost for the Drone2Map software?

Thanks

Dan

Re: ESRI UC 2015 new UAV mapping application insights

Ryan_Galbraith — Mon, 11 Jan 2016 20:27:42 GMT

Beta in Feb - just signed up for that and release in June, 2016

Re: ESRI UC 2015 new UAV mapping application insights

DanAllen — Mon, 11 Jan 2016 21:14:28 GMT

Ryan,

How did you sign up for the Beta? It does not show up in the early adopter website as a Beta program yet. At least with my log in it doesn't.

Thanks

Dan

Re: ESRI UC 2015 new UAV mapping application insights

Ryan_Galbraith — Wed, 13 Jan 2016 20:15:45 GMT

Contact your local ESRI rep. It is a special project. I think you must also have a drone that is compatible with the software. There is a short list.

Re: ESRI UC 2015 new UAV mapping application insights

CodyBenkelman — Wed, 13 Jan 2016 21:39:33 GMT

Nearly any drone should work, but note Drone2Map is for still frame imagery, not video. If you are acquiring video from a drone, our newest release of FMV (v1.3, available late Jan/early Feb) will be able to "multiplex" GPS data with a video file to geotag the video. More information coming soon Get Started with ArcGIS Full Motion Video (FMV/Drones/UAS/UAV)

re: Drone2Map, it's not the drone that we need to understand - the key is the camera (although the flight plan for acquiring imagery does impact the project as well). We'll have a long list of compatible cameras that should make the camera portion of project setup transparent to the user, but if you are using a previously unknown camera, the key parameters needed are simple - focal length and sensor size (mm) or pixel size (microns). GPS can be embedded in each image (EXIF tags) or an external file read in with the images. If you have these inputs, Drone2Map should be able to process your still frame imagery.

Re: ESRI UC 2015 new UAV mapping application insights

DanAllen — Wed, 13 Jan 2016 21:45:05 GMT

So it is safe to assume if you have a DJI Phantom 2 or 3 with standard DJI cameras, it should be supported by Drone2Map for still pictures?

Re: ESRI UC 2015 new UAV mapping application insights

nita14 — Fri, 26 Feb 2016 09:50:37 GMT

Hi All,

According to the press release "The photogrammetry engine in Drone2Map for ArcGIS is powered by Pix4D". Right, I suppose it means a higher price for the end user than Pix4D Mapper Enterprise, doesn't? What are Esri plans regarding partnerships with Pix4D?

Regards,

Adam