Let's Get Real With Real-time GIS: Mapping and Analytics

[AmyNiessen]

On Wednesday, May 16th, Ken Gorton and Morakot Pilouk‌ took the hour to cover a fast-paced introduction to GeoEvent Server, which is the server role that brings real-time capability to developers' ArcGIS Enterprise.

During the webinar, questions were asked that we ran out of time addressing during the recording, so we are featuring them here. Be sure to comment at the bottom of this blog post should you have additional questions or just want to compliment the presenters for their awesome webinar!

Q: Other than GeoEvent Server, can we use Stream Layer?

A: A stream layer can be used to connect directly to a web socket so no stream service is necessary. The only thing necessary is that the JSON messages sent out must be the same format as the JSON that returns from a query to a feature service. It’s documented at https://developers.arcgis.com/javascript/3/jsapi/streamlayer-amd.html#streamlayer2.  

Q: Is there a connector to store data to a traditional data warehouse such as MSSQL Server?

A: There are out-of-the-box connectors to write features to feature services. A non-spatial data repository, such MSSQL Server, can be the datasource for a feature service if you publish a map with a query layer that references data in that data repository. GeoEvent Server could then send features to that feature service.

Q: Can feature services use a big data store as its source or is it required to be a a traditional EGDB?

A: The data in a spatiotemporal big data store are exposed as feature services and map services and can be used as layers in ArcGIS applications, web maps, etc.

Q: Is GeoEvent Server a component of ArcGIS Enterprise?

A: ArcGIS Server is part of ArcGIS Enterprise. GeoEvent Server is an optional server role of ArcGIS Server. More info here: http://enterprise.arcgis.com/en/get-started/latest/windows/what-is-arcgis-enterprise-.htm

Q: Is GeoEvent Server part of Server for ArcGIS?

A: GeoEvent Server is an ArcGIS server role. Perhaps one way to look at it is that GeoEvent Server IS ArcGIS Server, but specifically configured to handle real-time data and processing exclusive of other types of ArcGIS Server capabilities (e.g. Geoprocessing services, Locator services, etc).

Q: Can this be used with Operational Dashboard?

A: GeoEvent Server can send data to feature and map services in ArcGIS Enterprise Data Stores, Spatiotemporal Big Data Stores, ArcGIS Online feature services, stream services, etc, all of which can be added as layers to web maps and visualized in Operations Dashboard, Web AppBuilder apps and other clients.

Q: How do you suggest handling data streams that have duplication of data or data that comes in out of order?

A: Some input connectors have the ability to only ingest data that is newer than previous data but apart from that GeoEvent Server does not provide any tools for validating data order or for de-duplication of data. 

Q: Can you update labels at a static position on the map?

A: The values of feature labels in web maps are determined by the values in the attribute field that backs them. GeoEvent Server can update attribute values of records in a feature service. Thus when the value of an attribute changes, any labels that reference that attribute field should reflect the latest updates.

Q: What is the cost of deploying GeoEvent Server?

A: The cost of deployment will vary widely depending on your system architecture, licensing requirements, and many other factors. I suggest you reach out to your Esri account representative for an answer specific to your use case.

Q: Does the 3DFx widget in ArcGIS Web AppBuilder support stream service?

A: Stream Services are not yet supported in web scenes and therefore not available as a source layer in a 3D Web AppBuilder app. The 3DFx widget is not available in a 2D Web AppBuilder app.

Q: Can I export data from Spatiotemperal data store as a feature class or CSV table?

A: One way to do this is to add the feature service from the big data store as a layer in ArcGIS Pro, then right-click the layer and select Data > Export Features. The resulting output is subject to the maxRecordCount setting of the big data store source, by default 10,000 records.

Q: Is there a processor that can enrich a EGDB feature class of events with values from other feature classes or rasters? For example, elevation from a DEM at an event's location.

A: The Field Enricher Processors essentially do a 1:1 JOIN operation between the geoevent and a record in an external feature service or file based on a common ID. In order to enrich a geoevent with a value that comes from a spatial query of an external data source at the geoevent's location you would need to develop a custom processor.

Q: Is the GeoEvent Server available in ArcGIS Online or only on ArcGIS Server?

A: GeoEvent Server is not available in ArcGIS Online. Here are the system requirements for installing it in your on-premises or cloud environment: http://enterprise.arcgis.com/en/geoevent/latest/install/windows/system-requirements.htm 

Q: Can I run an input with a specific time of day?

A: You can set certain connectors to run at specific intervals, but there is no way to set the exact time of day.

Q: You showed a GeoTab input connector in your partner list, but we can't find it. Can you send a URL?

A: https://www.arcgis.com/home/item.html?id=cf02f3b8564042db8de60f582e1ad2a3 

Q: Using a stream service, are the point objects selectable such that a user can view attribute values (in Operations Dashboard or web app)?

A: Web maps support pop ups on stream layers which allow you to view the attributes of a selected feature. While Web AppBuilder and Ops Dashboard maps can display stream layers, other Web AppBuilder and Operations Dashboard widgets cannot yet leverage the attribute data from stream layers.

Q: Does GeoEvent Server come with connector?

A: GeoEvent Server includes several connectors out-of-the-box: http://enterprise.arcgis.com/en/geoevent/latest/process-event-data/input-connectors.htm, output connectors: http://enterprise.arcgis.com/en/geoevent/latest/process-event-data/output-connectors.htm, and processors: http://enterprise.arcgis.com/en/geoevent/latest/process-event-data/processors.htm, Additional components are available for download from the following ArcGIS Online Groups: ArcGIS GeoEvent Server Gallery: http://www.arcgis.com/home/group.html?id=cdb23c8bd5ef42feb5fe74483a676844#overview, ArcGIS GeoEvent Partner Gallery: http://www.arcgis.com/home/group.html?id=3433c67e98384f9089a1f853ed74ddd5#overview, ArcGIS GeoEvent User Community Gallery: http://www.arcgis.com/home/group.html?id=9a41985604ec4301a21d6cd375e5762e#overview

Q: What happens if you're polling or subscribing to an external service, and an extra field gets added that you aren't expecting (i.e., it isn't present in the definition)?

A: Input connectors—Real-time Data Feeds and Sensors (10.6) | ArcGIS Enterprise 

Q: My organization has AVL data on a fleet of school buses. The GPS data is on a non-Esri SQL DB. What connector would be the best for connecting to this data? Both the DB and the portal are on our servers behind a firewall. 

A: One approach is to create a map document with a query layer that queries data from the database. Then you can publish that map document to ArcGIS Server as a feature service which will expose the query layer a feature layer. GeoEvent Server can then poll the data via that feature layer.

Q: Is stream service preferred compared to Feature service? Is that an extra cost or just another option?

A: Sending data to Stream Services is generally faster than sending to Feature Services and typically generates less network traffic. However Stream Services do not persist data in any sort of permanent storage. Thus each has its advantages and best use relative to the other. They are a core capability and do not require additional expenditures to enable. 

Q: Can I export the stream service data from Spatiotemporal data store as a feature class or CSV table?

A: One way to do this is to add the feature service from the big data store as a layer in ArcGIS Pro, then right-click the layer and select Data > Export Features. The resulting output is subject to the maxRecordCount setting of the big data store source, by default 10,000 records.

Still have questions, or did this Q&A get you thinking about more? Leave us a comment, and we'll get back to you!

Interested in questions asked during the webinar? Check out the webinar here: Real-time GIS: Mapping and Analytics - YouTube 

Don't miss our next GeoDev Webinar on Data > Design > Develop on June 13th! Follow us on Twitter @EsriGeoDev to keep your fingers on our pulse!