Select to view content in your preferred language

Gaussian splat layers in the native mobile SDKs

201
2
3 weeks ago
Status: In Product Plan
brian_terraformation
Occasional Contributor

This idea is to add support for Gaussian splat layers in the native mobile SDKs.  The last scene I made just supports 3D mesh in a native mobile viewer.  It should be noted that loading a scene containing Gaussian splat layer(s) in the ArcGIS native Swift SDK currently causes the scene to render blank instead of just falling back to the 3D mesh.  Might Esri already be in developing this?  Being a fairly new update to include Gaussian splats and it being a different file type that overlays the mesh, it's probably very challenging, but is this something you all are working towards?

2 Comments
MichaelBranscomb
Status changed to: In Product Plan

Good news -- We're currently working on this! Development is progressing well and we plan to include either in our upcoming release in August, or the subsequent release in December. 

 

It would be great to find out more about how you're planning to use this new layer type:

  • Have you built your own native mobile viewer? 
  • Which of the Native Maps SDKs did you use?
  • Which version are you currently using?
  • Which 3D view are you using - the global scene view or the new local scene view? 
  • What type of data are you displaying with Gaussian splats, e.g. urban areas, utility infrastructure, natural environment? 
  • How did you capture the data?

 

Thanks

Mike

brian_terraformation

@MichaelBranscomb Thank you for the good news!

  • Have you built your own native mobile viewer?
  • Which of the Native Maps SDKs did you use?

Yes, we built our own React Native iOS and Android app with an ArcGIS scene viewer. The app uses the Esri ArcGIS native SDKs for Swift and Kotlin via this new React Native + Expo wrapper expo-arcgis:
https://github.com/alex-krassavin/expo-arcgis/

Our lead developer is in contact with the author and the wrapper is working great.

  • Which version are you currently using?

We're using SDK 300.0 via the expo-arcgis wrpaper:
Swift: https://github.com/alex-krassavin/expo-arcgis/blob/29e0e836f64eb997ae87af3127bdf40a6040f5b1/ios/Expo...
Kotlin: https://github.com/alex-krassavin/expo-arcgis/blob/29e0e836f64eb997ae87af3127bdf40a6040f5b1/android/...

  • Which 3D view are you using - the global scene view or the new local scene view? 

Looks like both the Swift version and the Kotlin version use SceneView , which our lead developer believes is the global scene view:
https://github.com/alex-krassavin/expo-arcgis/blob/29e0e836f64eb997ae87af3127bdf40a6040f5b1/ios/Expo...
https://github.com/alex-krassavin/expo-arcgis/blob/29e0e836f64eb997ae87af3127bdf40a6040f5b1/android/...
https://developers.arcgis.com/swift/api-reference/documentation/arcgis/sceneview/
https://developers.arcgis.com/kotlin/api-reference/arcgis-maps-kotlin/com.arcgismaps.mapping.view/-s... 

  • What type of data are you displaying with Gaussian splats, e.g. urban areas, utility infrastructure, natural environment? 

natural environment

  • How did you capture the data?

DJI Matrice 4E, 3D mission, and processed in Drone2Map