Latest Contributions by ChrisBeyett

Hi Philip,  For your CSV data, have you created a new Spatiotemporal Data Store that corresponds to the new GeoEvent definition? When I work with Spatiotemporal data I've gotten into a habit of creating one data store per output GeoEvent definition. That way I can guarantee that records get written and data displays.  A good way to break this down and troubleshoot the root problem is to describe the workflow you implemented when using the CSV data. What differentiates it from the FAA Flights tutorial workflow? Normally the devil is in the details when it comes to GeoEvent Services and sometimes can be a simple fix.  Thanks,  Chris ... View more

Kjetil,  The java.exe process is used to facilitate many of the processes within GeoEvent, some of which are constantly maintained in memory. Normally when memory is kept allocated, it is because the program sill needs or will need to use that information again in the future. The best example of this is when using geofences, as each node of the polygon is held within the java.exe process memory for future reference. This behavior is actually expected, and isn't considered a memory leak. From what you've indicated you may need to increase the Java Heap Size again to give the process some more head room. However as long as you aren't seeing performance issues at the current level, you should be ok to continue.  - Chris ... View more

Hi Sharon,  This is what I suspected, and tells me that the index for the map service is most likely corrupted or not functioning correctly. Currently we've seen this behavior at both the 10.4.x and 10.5.x versions of GeoEvent, but the exact cause hasn't been isolated yet. I would continue working with Esri Support to find the best suitable workaround.  - Chris ... View more

Hi Sharon,  Thank you for the reply. If I may ask, is the map service not being created at all, or is it not being displayed within the GeoEvent Manager webpage? Esri Support has seen a few cases already of where the map service is getting created and can be viewed at the REST endpoint, but will not display within GeoEvent Manager. If this is the case, it is likely due to a corrupted index somewhere in the chain of products between the ArcGIS Data Store and the GeoEvent Manager. I'm currently keeping a tally on the number of customers with this behavior as it has proved tricky to isolate and test and I have not been able to reproduce it with any environment that I've setup. If this applies to you please let me know and I can add it to my list. If the map service is not being created at all, it could suggest another problem with one of the products.  - Chris ... View more

Hi Sharon,  First off apologies for the delay in this message. Secondly, are you still noticing this behavior? With the Spatiotemporal Big Data Store, the best place to start troubleshooting is the ArcGIS Server REST endpoint. The spatiotemporal map and feature services are exposed there, and you can perform queries to understand if the data itself is responding at this level. If you're getting good queries and responses at the REST endpoint, you may need to look further into the Portal side of things. There could be other variables such as network connectivity, SSL traffic or a mis-configuration that could affect performance.  - Chris  ... View more

Hi Mody,  There are 2 ways that you could approach this depending on what type of alert you are interested in: 1. The actual geometries of the GeoEvents touch (ie: when two GeoEvents collide) 2. The geometries fall within a certain threshold distance (ie: when two GeoEvents enter a specified distance from each other) The first scenario is pretty easy, and it would involve setting a filter to evaluate the spatial relationship between the geoevents (intersects any) which would send an alert any time 2 geoevents intersected.  The second scenario is more common, and still pretty easy to setup. You would use a GeoEvent Processor in your GeoEvent Service to create an on-the-fly buffer ring around each geoevent. The buffer ring would be set at to output your specified distance (ex: 1 mile around each aircraft in the air) and would apply to each event. You would then set a filter to evaluate the spatial relationship of the buffer rings, and send an alert when 2 buffer rings intersect.  Here's the documentation on the Buffer Creator as well as the other processors that come default with the GeoEvent Server: Processors—Real-time Data Feeds and Sensors (10.5) | ArcGIS Enterprise  - Chris ... View more

Wellington,  When GeoEvent reads a website for JSON, it uses the first object as the starting point for the message. The behavior you are seeing is typical when multiple elements are present in the JSON. To fix it, you should be able to set the Json Object Name parameter to "DATA". This will tell the input connector to start the message at the DATA element.  Thanks, Chris ... View more

Hi Allen,  I've also had trouble getting the Twitter API to conform perfectly to the Location X/Y pairs that I've set in the connector. However I think that this is a product of the API itself as I get the same general results from an search outside of the GeoEvent Server application. However what you could do it create an exact bounding box polygon of your Tweet area and use it as a geofence within GeoEvent Server. You could then specify the INSIDE or WITHIN spatial parameter and have all Tweets that fall outside of the polygon ignored.  I run the same workflow and a USA boundary polygon when using the Twitter Connector for USA-only Tweets.  - Chris ... View more

Hi Cameron,  At this time there is no CAT-specific connector that interfaces with GeoEvent Server, however you still may have luck reaching the underlying data. Do you know what format the data is in (JSON, XML, NMEA, etc) as well as how it's being transmitted (HTTP, TCP, WebSocket, etc)? Many times with specific applications GeoEvent Server can still interpret the data and yield the results you're looking for, it just may take some manipulation to do it.  - Chris ... View more

Hi Heather,  GeoEvent typically likes to issue a transactional type of request to an ArcGIS Online organization. They are made either to gather information regarding the ArcGIS Online organization (number of items the user owns, service metadata, permissions, etc) or to push data to a particular feature service. The type of ArcGIS Online role determines what type of action GeoEvent can make. Below is a general outline of what can be done with each role: User Role: GeoEvent can only poll from the specific user. No data can be written to the Hosted Feature Service. Publisher Role: Normally the best role for ArcGIS Online, as GeoEvent can both poll from and write to any Hosted Feature Service as well as create new ones Administrator Role: All functions of the publisher plus all rights to administer the organization. Use for testing/proof of concept, but it's always a best practice to limit the amount of administrative users within the organization. To your question of switching from built-in users, ADFS is a type of SAML login and actually sits on top of the ArcGIS Online login. When ADFS is configured, the organization will have the option to keep both the existing built-in user accounts as well as utilize the ADFS authentication. It normally displays as a login box with two options, prompting the user to choose either built in or ADFS credentials. You could setup GeoEvent with an ArcGIS Online built-in user with a publisher role and require all other domain employees to login using their ADFS credentials. It would be a great way to split up the workload of GeoEvent and designate it with it's own account. Also keep in mind that when using GeoEvent with a specific user account in the data store connection, GeoEvent will only be able to read items that are owned by this user. If an enterprise login user publishes a hosted feature service that should be used with GeoEvent, they will have to transfer ownership of that item to the account that GeoEvent is connecting as. Hope this helps, Chris  ... View more

Hi Sarah, Is this a new installation of GeoEvent Server 10.5, or did you upgrade from a previous version? From your description it appears that GeoEvent is receiving data points correctly from the website (since the count is increasing on the input) however it's not passing this data to other elements within GeoEvent. This could have many causes, including a RabbitMQ Messaging Service malfunction. Have you noticed any RabbitMQ failure messages in the GeoEvent logs? It may be worth including a zipped copy in a response for me to examine. Feel free to also include screenshots of the Monitor section in the GeoEvent Manager as well as the definition created and the GeoEvent Service editor if possible. - Chris ... View more

HI Kjetil,  I'm happy to announce that this functionality has been fixed at the 10.5 version for both the Feature Service and Map Service. You can now query both services with statistics and have more than 10 values returned. Below is a screenshot of the response at the ArcGIS Server REST endpoint that I've been testing on. Feel free to upgrade at your convenience to take advantage of this functionality, but I would also advise for testing the 10.5 release in a dev or testing environment first.  The bug that corresponds to this behavior is still marked as "Assigned", and I will work with the product team to ensure it's marked as "Resolved" moving forward.  Thanks for reaching out,  Chris ... View more

HI David, As you've noticed working with geofences within the GeoEvent Extension can get tricky depending on the polygons your're working with. I'll be answering the questions you posed as well as outlining the steps you'll need to take in order to ensure all polygons can be consumed within GeoEvent. Currently, when importing geofences in GeoEvent it stores the geometry information inside the system RAM. This is shown as an increase in consumed RAM utilization by the java.exe process (as you've seen in the Task Manager). The answers to your questions can be found below: 1. Since geofence geometry is stored in memory and can be constantly read and interpreted, more complex polygons will consume more system RAM until the 4 GB limit is reached. In many situations, the finite limit of polygons is actually variable, and I've seen the default max be as low as 100 polygons (very complex geometry) or as high as 20,000 (simplistic small geometry). 2. There is a way to increase the java.exe process heap size limit which will allow more geofences to be imported. However, doing so is at your own risk as any increased RAM usage could cause unintended consequences on the machine. That being said, I would start with increasing the limit to 8192 MB (8 GB) and assess the performance of the machine at that point. While you certainly could set the limit to 12 GB, it would be best to start small and continually test and assess in line with your organization's IT policy. Below are the steps needed to change the heap size from the 4 GB default to an 8 GB testing size:. a. Log in to the GeoEvent server machine, as we'll need to modify a configuration file in the installation directory b. Stop the ArcGIS GeoEvent Windows Service c. Navigate to the following directory: C:\Program Files\ArcGIS\Server\GeoEvent\etc d. Edit the "ArcGISGeoEvent.cfg" file, which is typically the second file in the directory e. About halfway down the file, you'll find a listing of Java parameters that GeoEvent uses. The parameter you want to change is commented with "# Maximum Java Heap Size" and is typically Java parameter 15. f. Change the value from -Xmx4096m to -Xmx8192m, save and exit the file g. Start the ArcGIS GeoEvent Windows Service h. Attempt to re-import the same block of geofences that you received the failure on before. These should now import successfully 3. Along with changing the Java Heap Size, another good trick for ensuring that geofences are imported successfully is to simplify the geometry as best as you can. Limiting the amount of vertices in each polygon will greatly improve the changes of it being imported into GeoEvent. 4. You are absolutely realistic in your logic pertaining to geofences. The 4 GB limit is in place by default and intended to work with the minimum system requirements for ArcGIS Server and the GeoEvent Extension. This may not be enough for some testing and production environments depending on the scope of the project you're working on. The maximum amount of unique geofences that I've seen in a production environment is just shy of 70,000. They consumed over 16 GB of system RAM and were incorporated into 22 different GeoEvent Services. That's not to say that it's the upper limit, just the most I've personally encountered. 5. Start with increasing the Java Heap Size as well as being mindful of the polygon complexity over time. Since you have more than 36,000 total polygons, you may not have enough system RAM installed to accomplish importing them all at the same time. This is why small batch testing is important, as your testing results can be used as a justification if the installed machine resources need to be increased over time.  - Chris ... View more

Hi Cassidy,  When observing the attached photo of the logs, it indicates a RabbitMQ Platform Service failure. This platform service is housed inside the ArcGIS Server installation, and facilitates the movement of messages from the input connector to other components within GeoEvent. I would start with conducting a software repair on the ArcGIS Server, as the platform services files may have become corrupted at some point. Although updates may not have been installed, a machine failure could be a possibility as well. It would also be fair to rule out any machine failure as a potential cause alongside of the ArcGIS Server/GeoEvent software.  - Chris ... View more

Hi Jun,  Upon examining the logs (both karaf.log and karaf.log.1) you'll find the following line listed a few times: 2016-11-21 11:13:35,169 | ERROR | rint Extender: 3 | LicenseEnforcer | 336 - com.esri.ges.rest.cxf-service - 10.2.2 | Our license isn't valid.  Shutting down. I would recommend running the "Software Authorization" wizard and providing the .prvc or .ecp file for the ArcGIS Server. Also, was the GeoEvent Processor installer run as "Admin"? Sometimes when a user installs GeoEvent without Admin privileges it does not get installed properly.  - Chris ... View more