topic Re: Missing DSM & Ortho + Point cloud at wrong elevation in ArcGIS Drone2Map Questions

Missing DSM & Ortho + Point cloud at wrong elevation

LarsElmkær_Chwastek — Mon, 25 Sep 2017 07:08:56 GMT

Hi Guys,

I'm having a problem with the products of my D2M project. First of all, when running the project it does not create a DSM or Ortho even though I have selected them in the processing options.. I have taken a look at the Report (attached), and that actually has the correct ortho and DSM shown... So I don't understand why I don't get any products in the 2D folder..

I have created many projects before and this has never been an issue.

Second issue is, that my Point Cloud is at a wrong elevation. It is shown at a height of 169 meters, which is actually the height that is imprintet in the images themselves were they were taken. However no matter how I set the vertical coordinate system or the vertical conversion, the point cloud is still shown at the before mentioned height??

The guy who flew the images, have created a perfect result in Pix4D... He has used only standard settings and since Drone2Map is built on Pix4D technology I don't understand why I'm having this problem....

Anyone?

Best regards,

Lars

Re: Missing DSM & Ortho + Point cloud at wrong elevation

JamesTaylor3 — Tue, 26 Sep 2017 14:09:27 GMT

Hi Lars,

If this is a DJI Drone there can be errors in the altitude values in the image EXIF tags. There is a method of exporting and correcting the altitudes that will correct the point clouds and mesh elevations. I will look for some documentation on how to do that and get it to you.

As for the Ortho and DSM missing could you do the following:

- Edit %LOCALAPPDATA%\Programs\ArcGIS\Drone2Map\Bin\data\config\log.json
- Change the logLevel to "debug" and save the file
- Start D2M, open the project and run processing

Then send me the following (I'm PM you my email):

- Zip file containing all the files in: %LOCALAPPDATA%\Drone2Map\log
- Zip file containing all the files in: C:\Users\<user>\Documents\Drone2Map Projects\<project<\process\project\logs
- C:\Users\<user>\Documents\Drone2Map Projects\<project<\process\project\project.log

Re: Missing DSM & Ortho + Point cloud at wrong elevation

LarsElmkær_Chwastek — Wed, 27 Sep 2017 08:15:52 GMT

Hi James,

Yes it IS a DJI drone (Phantom4), so that sounds like the problem I'm experiencing. It would be most appreciated, if you could send me the documentation or lead me in the right direction :-). I also received the point cloud that he had created in Pix4D, which is also flawed in the elevation of his first flight. So Pix4D is also a "victim" of the flawed images.

I have started up a project, which usually runs for 5-6 hours, so I'll send the information to you when it is done.

Thank you for your feedback so far 🙂

/Lars

Re: Missing DSM & Ortho + Point cloud at wrong elevation

JamesTaylor3 — Wed, 27 Sep 2017 13:06:43 GMT

Drones sometimes record inaccurate flight heights in the EXIF tags of the images causing products to be built at the wrong elevation. This includes 3D point clouds and meshes as well as 2D DSM/DTM images and contours lines. To correct the images for use in Drone2Map for ArcGIS 1.2 it is necessary to create a file with more accurate altitudes which can be imported into Drone2Map for ArcGIS 1.2.

The steps to correct image altitudes are detailed below. (Drone2Map for ArcGIS 1.3 will contain functionality to Adjust Image Altitudes automatically):

To adjust image altitudes, you will need three things:

A CSV File containing the image name, lat, long, alt fields
The Relative Altitude (height above ground) at which the drone was flown
The Orthometric Elevation on the ground above which the drone was flown

Step #1: Creating the CSV file:

Create a new Drone2Map for ArcGIS project
Select the “3D Mapping Template”
Change the “Vertical Reference” to “No Conversion”
Add the images to the project
Click “OK”
Open the “Image Properties” dialog from the ribbon
Click the” Image Options” dropdown
Click “Export All”
Click “Save”

Step #2: Finding the Relative Altitude:

You will need the altitude you specified in the Mission Planning application to fly the drone at. If you remember this altitude you can proceed to the next step, if not you will need to retrieve the relative altitude from the EXIF tags of one of the project images or some other file output by the Mission Planning application (Note: Not all drones record the relative altitude).

You will only need the Relative Altitude of a single image, usually just the first image in the project (taken once the drone reached the proper altitude of course).

Retrieving the Relative Altitude from the EXIF tags:
- You will need software which reads the EXIF tags of an image. We will leave it to you to search the internet and find a suitable application, however we have used Exiftool without any issues in the past (https://sourceforge.net/projects/exiftool/)
- Look for the tag containing the Relative Altitude. For example with Exiftool:

About : DJI Meta Data

Format : image/jpeg

Absolute Altitude : +230.33

Relative Altitude : +27.10

Other locations of Relative Altitude:

Some Mission Planning applications write additional files that may contain image information. Look in all project and text files output by the Mission Planning application.

Step #3: Getting the Orthometric Elevation:

You will only need the Orthometric Elevation of the point at which a single image was taken, usually just the first image in the project (taken once the drone reached the proper altitude of course). Since drone project areas are relatively small this elevation can be applied to the entire project to successfully produce products representing the proper elevation.

We will be adding a Ground Control Point (GCP) to the Drone2Map for ArcGIS project temporarily to get the Orthometric Elevation. This GCP can then be deleted.

Open the Drone2Map for ArcGIS project you created in Step #1
Click “Manage GCPs” in the ribbon
In the “Manage GCPs” window click “From Map”
Click on the first image point in the map (you can close the “Image Viewer” if it opens)
Record the “Elevation ” of the GCP added to the table in the “Manage GCPs” window
Click “Clear” (Remove All GCPs)

Step #4: Correcting the Image Altitude values:

Open the CSV File you created in Step #1
Change the “altitude” column for all images to the sum of Relative Altitude + Orthometric Elevation
Save and close the CSV file

Step #5: Applying the corrected Image Altitude values to the project:

Open the Drone2Map for ArcGIS project you created in Step #1
Open the “Image Properties” dialog from the ribbon
Click the” Image Options” dropdown
Click “Set All GPS Source”
Browse to the CSV file you created in Step #1
Click “OK” in the “Set GPS Source” dialog
Click “OK” in the “Image Properties” dialog

Step #6: Run the project:

The project will run and produce products that reflect the proper Orthometric Elevations and will hence display properly on an Orthometric basemap/surface such as those in Drone2Map for ArcGIS and ArcGIS Online.

Re: Missing DSM & Ortho + Point cloud at wrong elevation

LarsElmkær_Chwastek — Wed, 27 Sep 2017 13:51:15 GMT

Hi James,

Thank you for the very detailed step by step procedure, that gives me a great guideline for future issues 🙂

I have already extracted the EXIF data with another tool and there is no Relative Altitude data within. So I'll have to speak with my pilot about that. Otherwise everything else seems pretty straight forward.

And I'm looking forward to version 1.3 😉

/Lars