Latest Contributions by RJSunderman

Hello Dennis - I don't see anything wrong with the JSON sample you posted. I was able to create a basic 'Receive JSON on a REST endpoint' Input and POST the sample to the GeoEvent Processor Input's REST endpoint. Configuring my Input as shown in the first illustration below, I allowed a new GeoEvent Definition to be created. I've included an illustration of the generated GeoEvent Definition below. When I post the JSON, I get two events received. I can output those to a system text file as JSON without any problem. I noticed that in the second record, the one whose driverID is 83886089, a few of the fields are null. If I delete the GeoEvent Definition and then swap the order of the events in the list so that the record with the null attributes is first ... the generated GeoEvent Definition does not contain fields for the attributes which were initially received as null. I'm not sure, but it might be that you have a GeoEvent Definition which does not match the content discovered by the Input connector, so it discards the event it cannot recognize. That would explain why you are observing the event count not incrementing. You might try deleting your existing GeoEvent Definitions and seeing if the Input is able to create a new one based on data it receives. The only other piece to the configuration that I notice is that your connector, aside from specifying connection credentials and a polling frequency, is specifying a 'Parameters' value of 'minutes=1440'. I'm not sure what that parameter is, or it is plays into the issue. - RJ ... View more

Hello Chen - I'd like to make sure that I understand your question. Are you working with a single data stream and need advice on how to manually configure a cluster of GeoEvent Processor instances which will work collectively to pull and processing individual events from the high volume data being received?  Support for high-availability and clustering are concepts being developed for the "11" product release which will feature a new type of stream service input. We are working to make this functionality available later this year. It may be possible to manually configure high-availability and clustering for the current 10.2.1 product release - but it depends on what exactly you are trying to accomplish. If you are working with several different (independent) data feeds, you can scale your site architecture by installing additional instances of GeoEvent Processor onto the GIS Servers in your ArcGIS for Server site. You would simply need to make sure that each instance of GeoEvent Processor had its own Inputs, Outputs, and GeoEvent Services. - RJ ... View more

Hello Zubair - The GeoEvent Processor Simulator reads text files containing simulation data generally expressed in a comma separated format. It is also capable of connecting to your local ArcGIS for Server site and retrieving data from a feature layer to use to simulate events. Please refer to the instructions included in the Introduction" rel="nofollow" target="_blank">http://www.arcgis.com/home/item.html?id=265c334a47994dcc95e1bd57cf20e98e]Introduction to GeoEvent Processor tutorial available from our Product" rel="nofollow" target="_blank">http://www.arcgis.com/home/group.html?owner=GeoEventTeam&title=ArcGIS%20GeoEvent%20Processor]Product Gallery for additional help with using the GeoEvent Processor Simulator. The development team is not in a position to make recommendations with regard to commercial services or equipment providers for compiling GPS data. If you are looking for sample simulation files, we have some included with the Introduction to GeoEvent Processor tutorial ... just download that tutorial package and you can extend the sample simulation data you find there to meet your needs. Hope this information helps - RJ ... View more

Hey Mark - Sorry for the delay in getting back with you on this. If I restart my xmpp server the instant message outputs do not work again until I restart the output. Is the instant messaging output supposed to automatically reconnect to the xmpp server? Looking at the implementation, no, the Output is not going to automatically attempt to reconnect to the XMPP server if the server is taken off-line and later comes back on-line. This is probably a functional gap that we should address, since the Output remains in the 'Started' state and there is no indication to the user that the Output needs to be stopped/restarted. Is there any way to tell them to try to automatically reconnect or some other way to deal with this? Is there any way to tell if an IM output is not connected? No, there is no indication through GeoEvent Processor Manger that the Output needs to be cycled or that it is not connected to the XMPP server. As part of the enhancements for the 10.3 / 11 product release we can look into having the Output determine its server connection status when a GeoEvent is received, attempt to reconnect if not connected, and log an error if a connection to the server cannot be realized. This would improve reliability. The only work around currently available to you would be to develop some sort of "status monitor" as a JavaScript which would begin polling the server to see if it was available (after detecting that it had been shut down) and then command the GeoEvent Processor Output to restart through the component's administrative REST endpoint. I am using openfire XMPP server and it requires the chat room to be configured before anyone else can join. Configuring a chat room appears to be something that is defined/required by the XMPP RFC/spec. Is there anyway to handle chat room configuration with the IM output? No, implementing the Output to handle chat room creation and configuration is not supported. We had initially considered this, but had to limit the scope of the development. The XMPP connector was intended to highlight the potential for event notification via Instant Messaging. We decided to leave creation and configuration of chat rooms to the XMPP server administrator. We identified quite a few potential configurations with regard to chat rooms using different varieties of XMPP servers and couldn't commit to support this with the initial product release. If you would, please visit the ArcGIS" rel="nofollow" target="_blank">http://ideas.esri.com]ArcGIS Ideas portal and post ideas for product enhancements. The forums are one way of getting ideas to the development team, but the Ideas portal allows users to vote for ideas that support their use of the product. Popular requests have a better chance of making in into our backlog for development during a future release. If you do post the idea, please enter GeoEvent Processor into the TAGS and check ArcGIS Server beneath CATEGORIES to help us track the submission. Thanks - RJ ... View more

You also might try getting the GeoEvent Service configuration to a working state on your Win7 machine, then exporting the GeoEvent Processor's configuration from the Site > GeoEvent Processor > Configuration Store page, and importing the XML into a clean instance on your Win2008 R2 machine. An easy way to clear out the configured elements (Inputs, Outputs, GeoEvent Definitions, etc.) is to stop the Windows service running GeoEvent Processor, locate and delete the files from the C:\ProgramData\Esri\GeoEventProcessor folder. I would recommend leaving the ...\certs folder so that you don't have to re-import the SSL certificate as trusted. Also, if you are running 10.2.0, be sure to leave the ...\connectors folder (this will be rebuilt for you if you're running 10.2.1). If you find that a more aggressive cleaning is needed, you can locate and delete the C:\Program Files\ArcGIS\Server\GeoEventProcessor\data folder to remove any cached elements; the folder will be rebuilt when you restart the Windows service. As long as both machines are running the same version of GeoEvent Processor, you should be able to share configurations this way so that you don't have to reconfigure Inputs, Outputs, GeoEvent Definitions, and GeoEvent Services. There's a lot of touch points you have to make sure you've replicated on each box ... and forgetting something simple like a GeoEvent Definition or tagging a TRACK_ID onto a event definition field can easily make it look like one server is working and the other isn't. - RJ ... View more

Hello Luis - What you are observing is by design. The adapter used with the TCP/Text Output connector reports date/time values using your local system's locale. I'm in the Pacific Time Zone (California, USA) and using the GeoEvent Simulator's feature to 'Set value to Current Time' I can insert the local system date/time into events as they are sent into GeoEvent Processor and observe "local time" values displayed as text in either a CSV system file or as text via a TCP Socket. When I output the event data to a TCP socket using the 'Publish text to a TCP Socket' Output connector, and use the use the TCP Console application to  observe a text representation of the data, I see my local system's date/time. The 'Text' adapter has converted the date/time object within the GeoEvent to a text representation. When I output the event data to an ArcGIS Feature Service, the GeoEvent's date/time object is handled by the JSON/FeatureService adapter and transport. The date/time representation in the feature service is a Long Integer recording the number of milliseconds since midnight 1/1/1970 UTC. If you query the REST endpoint of your feature service to obtain this Long Integer value and use a conversion utility such as http://www.epochconverter.com/ you should find that the value obtained from the feature service can be converted to a GMT value as well as offset to your local time zone. It's all about what client you are using to view a representation of the date/time, and how that client is converting the event data it receives in order to display it for you. Hope this information helps - RJ ... View more

Hello Hiro - No, there's no known issues with the sample server. I was able this morning, using my 10.2.1 configuration, to create a new input using the web socket endpoint (ws://geoeventsample1.esri.com:8080/exactearthservice) we've been referring to in this thread. Are you able to reach the HTTP endpoint through a browser? Please take a look at the debugging steps outlined in my reply on 21-Nov-2013 in this thread above. You might be able to obtain some additional information on why the connection is being refused if you're able to step through the JavaScript using the Chrome developer tools. I was able to visit the demosite page (http://geoeventsample1.esri.com/demosite) on a mobile device and connect to the ExactEarth Vessel Tracking service sample from there. - RJ ... View more

Hey Adam - I have opened up a GEP Service to edit it in IE9 and Chrome. The screen remains blank and locks up in IE9. Everything works in Chrome... If you'd like, I can take a look at the GeoEvent Service's layout and properties if you export the XML configuration and send it to me. You're observing this using the 10.2.1 release? Have you tried clearing the IE browser cache, logging-out and back into Manager? There was a security feature added to 10.2.1 which automatically logs you out after 1 hour. The time is configurable from within a product config file if the log-out is getting in your way. I've sometimes seen odd behavior when my session has expired and I try to do something like open a GeoEvent Service for editing. I am not able to delete a connector line between inputs, processors, filters and outputs. For example, I want to insert another processor in the middle of the Service between two others I wish to keep. How do I eliminate the original line? We can look at adjusting the pixel tolerance if it's proving difficult to select a connector line. You should be able to click the line (it will highlight/glow when selected) and press 'Delete'. I also miss being able to copy and paste processors (or even just equations or lists) from one service to another and just selecting a tab to get back and forth between services. We will look into being supporting copy/paste of user entries from the different properties panels. I think the feature was added to the 10.2.2 release (due out March / April) to copy service elements such as processors and filters within a service, but you still won't be able to copy them from one service to another. As far as working with tabs ... can  you try using the Browser's tabs, effectively opening a new window, and working on the two services you want to edit that way? Please let me know if that works for you. Thanks - RJ ... View more

Hey Dennis - There are known issues when using IE8 to launch the GeoEvent Processor Manager.  If I remember correctly, these centered around registering Data Stores with the 10.2.0 product release. I will see what I can do to evaluate 10.2.1 Manager behavior under IE8. It's possible, given the diagnostics you provided, that there is something relatively easy we can identify for the 10.2.2 product to better support the older browser. But please know that Esri Support recommends users upgrade to either IE9 or IE10 when running Server Manager. GeoEvent Processor is using the same technology for our Manager, so we are going to have to make the same recommendation. Please refer to the on-line help System" rel="nofollow" target="_blank">http://resources.arcgis.com/en/help/system-requirements/10.2/index.html#//015100000072000000]System Requirements for Server for additional information. ArcGIS Server Manager supported browsers Firefox 10 or higher Google Chrome 10 or higher Internet Explorer 7, 8, 9, and 10 It is recommended that you use Manager in either a Firefox, Chrome, or Internet Explorer 9 or 10 browser for the best possible experience. Using Internet Explorer 7 and 8 may result in a lower-quality display of Manager. ... View more

Hello Mark - Does the field enricher work with GUID fields No, the Field Enricher processor has restrictions on which fields can be used to join the event's table/schema to the enrichment's table/schema. Currently the field type in the published feature service must be one of esriFieldTypeInteger or esriFieldTypeString. (The data type esriFieldTypeSmallInteger may also work, but I've not been able to verify that). I'm trying to create Geo fences that use the guid as the name and then do a field enricher join based on the guid to append data from the geo fence. I'd recommend that you try using a Field Calculator to create a String equivalent of your GUID in a new field. You might then be able to join the event's STRING to an enrichment table's GUID. If that does not work you'll have to rework your event data and the attribute data of your GeoFence to use Strings and Integer values for enrichment. - RJ ... View more

Hey Dennis - Thank you for your effort in preparing  the JSON representation of your input and event definition. As it turns out, this issue is much easier to reproduce than I initially thought. I"?ve replicated it in Chrome as well as Internet Explorer 9 and 10. This will be a known issue for the 10.2.1 release. We are looking to address the issue in the 10.2.2 product release which should be publicly available late Q1 or early Q2 this year. I"?ll include some screenshots below, for those who discover this thread later, but the work around (as you discovered) will be to <tab> to reveal any input fields missing from the display. You can also use your mouse"?s scroll wheel to scroll further down than what the vertical scrollbar on the property panel currently allows. The issue is that the pop-up dialog containing the configurable properties has a couple of static portions and a dynamic portion in its layout. You can use your mouse"?s scroll wheel to scroll through the dynamic "frame"� within the property panel. Consider the screenshots below "? the area dashed in red is the "dynamic"� portion of the property panel. Changing the processor type from "?Field Calculator"? to "?Field Mapper"? changes the content in the middle of the panel. When I select a GeoEvent Definition with more than a few fields (such as the product"?s incident event definition) the dynamic part of the panel runs past the panel"?s bottom edge. I can either <tab> through the fields in this portion of the display, or use my mouse"?s scroll wheel to scroll and reveal the remaining input fields. This obviously needs to be fixed since using the scroll bar to scroll to what you think is the bottom of the panel doesn"?t work. You could of course try maximizing your browser window to provide more real estate for the Manager and the pop-up properties panel "� but this may not be an option depending on screen resolution or if the size of your browser window is limited by a VM management console. Thank you for bringing this to our attention - RJ [ATTACH=CONFIG]30540[/ATTACH] ... View more

Hello Dennis - Would you mind sending me the JSON you are using? Are you using a File/Text input or are you POSTing the data to a GEP REST endpoint? I'd like to try and reproduce what you are observing and want to follow as close as possible the steps you followed to cause the problem to manifest. I may also need a MPK map package defining the schema of the features you publish as a feature service, so that I can configure a field mapper from the JSON to the Feature Service schema. Thanks - RJ ... View more

Mark - I was able to confirm that neither the syntax ${FieldName[idx]} nor ${Fieldname}[idx] appear to work with the 10.2.1 product release when attempting to configure an SMS or E-mail output to pull values out of a list added to a GeoEvent by a GeoTagger processor. I think I'm able to do what you're trying to do, however, if I incorporate a Field Calculator. I reconfigured the GeoTagger processors in my service to use the 'List' GeoTag Format rather than the default DelimitedValue format. Then, before the enriched event is sent to the Output connector,  I configured a Field Calculator (see illustration below) to extract a String element from the List into a new field. Then I reference the new field in the email-text-out Output, to avoid having to combine the square-brackets required for indexing with the curl-brackets used to indicate in the Output's configuration that we are inserting a value from an event field. [ATTACH=CONFIG]30413[/ATTACH] You might recognize that a GeoTagger processor is really a specialized implementation of a Field Enricher processor and a spatial filter and consider exactly what you are trying to accomplish with the event enrichment being performed by the GeoTagger. If you were to configure the GeoFences property of your GeoTagger with ".*/.*" the processor would consider all GeoFences in all GeoFence Categories. In this case, I don't think you'll be guaranteed that enrichment will occur in the same order every time. That is to say, if you always pull the 0th item from the GeoTags field (assuming that field is a List) you may not always get the name of a GeoFence from the same category (assuming that you have GeoFences in more than one category). Multiple GeoFences, which may or may not overlap, which are organized in multiple categories, might necessitate you take a specific approach when designing your GeoEvent Service. We will look into addressing the apparent syntatic limitation when working with event fields which are Groups and Lists in the different Notification output connectors. Hope this information helps - RJ ... View more

Hello Mark - Would you mind packaging your map document and data as a MPK and sending that to me?  I'd like to take a look at the features used to publish the feature service. As for your second question, synchronizing your GeoEvent Processor's GeoFences through the MapServer endpoint is really the same as using the FeatureServer endpoint. GEP is retrieving the coordinate data from the features in the service and then using the retrieved coordinates for its spatial comparisons. GEP is not referencing the actual features from the feature service, so there's no clear benefit to using the MapServer over the FeatureServer endpoint. - RJ ... View more

Hello Mark - Is there any documentation on the GeoTag format property of the Processor element? I don't really understand the purpose or intended usage of this option. No, the Tutorial" rel="nofollow" target="_blank">http://www.arcgis.com/home/item.html?id=265c334a47994dcc95e1bd57cf20e98e]Tutorial - Introduction to GeoEvent Processor currently available on the Product Gallery does not explain the three options for the GeoTag Format property of the GeoTagger processor. It uses the default (DelimitedValue) without explaining what the other options (Group and List). I will work to better address this in the version of the tutorial being developed for the 10.2.1 product release. If I remember correctly, 'Group' will create a cardinal list of group elements, with the GeoFence name (and optionally the category name) of each GeoFence which satisfies the spatial expression (e.g. INSIDE .*/.*) whereas 'List' generates a simple cardinal list with the GeoFence name (and optionally the category name) of each GeoFence as separate list elements. So the 'List' enrichment similar to 'DelimitedValue', except that each value is in a list rather than in a String separated with commas. Your best bet for now is to review the GeoEvent Definition created by the GeoTagger processor and look to see how it defines the field element containing the event enrichment values. Is there anyway to access the separate items in the geotags fields? If you are using the default, DelimitedValue, to combine the GeoFence names (and optionally category names) of the different GeoFences in which your event is INSIDE (for example), then you only have a comma separated list of values with no way to index into the string. If you were to experiment with using either the Group or the List output format options, then you might be able to include an expression like ${GeoTags[0]} to obtain the first ordinal from a cardinal field GeoTags. Whether that gives you a String (Category/FenceName) or a Group element (with subfields .Category and .Name) depends on whether the GeoTagger processor is configured to enrich events with a 'Group' or 'List'. I haven't tried this myself, so I'm not sure of the syntax. I will try to make some time to do so and reply back to this thread. - RJ ... View more