Problem creating an OIC with Insta360 x3 videos

Question

Hi Imagery and Remote Sensing community, I would like to create an Oriented Imagery Catalog (OIC) in ArcGIS Pro using videos recorded by an insta 360 x3 camera. I have a problem, when I connect the camera with a GPS to obtain the coordinates, these coordinates are stored in a .gpx file independent of the .mp4 file of the video. I would like to know if anyone knows how I can associate each coordinate with each frame of the video and how I can create the OIC with this video.

CodyBinkelheim · Answer

Thanks for catching one of my errors.  I discussed this with a colleague, and realized that my post above from earlier today offered poor advice.  Assuming I'd referenced the correct tool (GPX To Features tool), you COULD follow what I offered but it's more complicated than necessary.  Assuming you have Microsoft Excel, I had forgotten that Excel can automatically read and reformat the GPX file, so that is a much simpler first step to get the timestamp + lat/long/elevation (etc.) metadata into a table format.  You will still need to add additional fields - email me if you need documentation on the content of the video metadata table.

However it's not necessary to extract frames from the video as GIS-Cambria suggested.  That is another alternative, but you'd then be limited to viewing the extracted frames, not the video.   The "Oriented Imagery Classic" tools at https://www.arcgis.com/home/item.html?id=36ee0bbedca64a5a8b68d7c69ab51728 directly support video today.

At risk of further confusion, note that Oriented Imagery is now being integrated as a native capability in ArcGIS Pro - read this blog to learn more -  but today (Pro v3.2) video is not yet supported in the integrated version.  Video support should be added in 2024 (but watch our blogs for confirmation of when this will be available).

CodyBinkelheim · Answer

Apologies to anyone that was confused by the above post - I offered the wrong GP tool (as GIS-Cambria observed).  I meant to post the GPX To Features tool.  See my additional comments below

GIS-Cambria · Answer

If you already have the GPX file then you don't need a conversion from feature to create a new GPX file. You will need the GPX To Features tool. From there you can export the table to a csv format to match points to timestamps and prepare your table with the required fields as @CodyBenkelman states. Another approach could be to use a folder of images. An option to use OIC would be to find a tool that will let you extract images from your video (ffmpeg is one) and set the output interval based on frame rate or time; thinking 1 second is default to match GPX log/timestamps. IIRC the Insta360 Desktop editor will let you extract images to a folder. I don't know if extracting 360 images from the video will inherit the native 360 headers to be recognized as 360 photo. Anyhow, these two steps would then allow you to use OIC tools with the .csv file, and the extracted images folder to build your OIC. According to this link video is supported. Hopefully the video process or the extracted images workflow help you in esri and OIC. Mapillary could be an option outside of esri and then you can use a companion widget with a Mapillary account.