|
POST
|
Nicholas Gray, Have you tried calculating the two string fields (date and time) into one ISO 8601 compliant string into a new field? I don't know how your original date and time strings look. You may have to do a bunch of substring() function calculations to pull out pieces of everything, like Year, Month, Day, Hour, Minute, Second, Millisecond and put them into their own string fields - and then calculate them all together into one compliant "DateTime" string. Depending what time zone your data stream sends it's date and time in, you will probably have to add it to the string. For example, if DateField value = 07/18/2019 and TimeField value = 1630 , you would have to pull out all of the elements of both date and time given and place them into new string fields using Substring Field Calculations in GeoEvent. (In this case I am assuming that your date data always has 2 characters in Month and Day with leading zeros): Year: 2019 - calculated into "year" field with expression substring(DateField,6,-1) Month: 07 - from substring(DateField,0,2) Day: 18 - from substring(DateField,3,5) Hour: 16 - from substring(TimeField,0,2) Minute: 30 - from substring(TimeField,2,-1) Then the calculation to concatenate everything back into another string field ISODate: Expression: Year + '-' + Month + '-' + Day + 'T' + Hour + ':' + Minute + ':00+00:00' Result: 2019-07-18T16:30:00+00:00 (This is assuming that the feed is sending date/time in GMT - change the +00:00 to whatever your time zone is if the time is local - mine would be -04:00) That would be the first step. You could then just use a "Push JSON to an External Websocket" output to push the ISODate string into a "Receive JSON on a Websocket" input, with the field definition for the "DateTime" field set to Type: Date. From here, you could process anything else you need and then push to a Feature Service with a DateTime field defined as Date. A very good Blog Post to view too. --Adam
... View more
07-18-2019
11:04 AM
|
1
|
1
|
2197
|
|
POST
|
Thank you . I need to update GeoEvent because of another issue anyway, so I will try this in another environment after the upgrade is complete.
... View more
06-14-2019
04:22 AM
|
0
|
0
|
3027
|
|
POST
|
Hi Jake Skinner, Thank you for the quick reply. I am going to try this. Just one thing - The initial "Lightning Strikes" feature service you speak of is POINT, right? Not sure what NOAA offers for lightning strikes individually - I just know that they have the Lightning Strike Density service. I use the ENTLN feed (paid) that provides points. --Adam
... View more
06-13-2019
08:03 AM
|
0
|
1
|
3027
|
|
POST
|
Jake Skinner - maybe you could throw your two cents in here... I looked the Event Volume Controller Processor up and found that I must upgrade to 10.7 to get it. One more reason to get my butt in gear. However, I am not sure that I can use this by itself for my process. I need to know when the first event strikes within the GeoFence - to send out the first alert message (ex: "Lightning has been detected within 10 miles of the CENT01 tower. You will be notified again when 10 minutes have passed without another lightning strike within 10 miles of CENT01.") It appears that the first event will pass and I can use it for the email/text alert message. I do not see in the instructions if there is a tag added by the processor to tell if it is the opening event, or a closing of the event due to no events in 10 minutes.... I then need to notify of when 10 minutes has gone by within the GeoFence without another lightning strike. In other words, I need to re-start the timer after each lightning strike within the GeoFence until I get NO lightning strikes within the GeoFence for 10 minutes. That message would look like: "No lightning has been detected within 10 miles of CENT01 for the last 10 minutes" indicating that it would be OK to begin work again. If the processor simply lets the first event through, waits for 10 minutes, and then lets another one through, this would just tell me that there may or not have been a continuous stream of lightning strikes within any given GeoFence for the last 10 minutes. Does it notify when the processor closes due to the time restriction? I am trying to look at this processor in combination with a few others that I know about - but am struggling to find a solution. --Adam
... View more
06-12-2019
11:36 AM
|
0
|
3
|
3027
|
|
POST
|
Thank you Morten Grude. I haven't heard of this processor. I'll look for it. --Adam
... View more
06-12-2019
11:02 AM
|
0
|
0
|
3027
|
|
POST
|
Thanks for reading. I am struggling to wrap my brain around this. I have a lightning strike service. I need to notify a team of tower workers of any lightning activity within a 10 mile radius of their work site and then notify them when 10 minutes have passed with NO lightning activity. I already have my 10 mile #geofence for each tower and a #geofilter in my service. Last year, I just ended this with a #geotagger and an email - text output to send a text message to the workers. Their phones blew up with every lightning strike within a ten mile radius. They were not happy with me. This time, I want to notify them of the first lightning strike and only notify them again when 10 minutes has elapsed since the last lightning event within 10 miles. Since lightning strikes are unique, I would just add a Track_ID of the Tower Name from the geotagger to keep the detection unique to any GeoFence that may have lightning activity. I'm going to try a few ideas and come back here later to see if anyone has any suggestions. I need to figure out if the Incident Detector sends a message after the time limit expires. I have only used the Track Gap Detector, but that does the opposite of what I need this to do. I am afraid that I will use lots of resources if I use the TGD for this, as I will be keeping a gap open for long periods of time just to say 10 minutes have elapsed.... Thanks for any input! --Adam
... View more
06-11-2019
08:47 AM
|
0
|
8
|
3265
|
|
POST
|
Hi Hilary Curtis, I am attempting to work through this same problem. collaboration portal_for_arcgis arcgis_online portal The Portal Admin log shows this: The Guest (Portal) shows this: The Host (ArcGIS Online) shows this: ... ... My Portal (Enterprise) install is NOT internet accessible (intranet) but it is configured correctly to pass through our enterprise proxy. It is also configured with Domain Certificates. It is secured through Active Directory. Roles and Users are managed through Portal. The ArcGIS Online side of this collaboration is configured to use a resource account that is in the Active Directory and registered as a Portal user. Right now, the collaboration has that User ID as: user1@DOMAIN, as the user is listed within Portal. I am wondering if it needs to be changed to DOMAIN\user1. Looking at the Admin Log - in the "USER" column - I am wondering if it is even getting credentials.... Any ideas would be great! Thanks, --Adam
... View more
05-28-2019
05:30 AM
|
1
|
11
|
4858
|
|
POST
|
I have just successfully queried FlightAware's FlightXML feed with GeoEvent Server at 10.6.1. It is much cheaper than the Firehose - unless you are querying a large amount of flights or just want them all. Contact me if you want the rundown on how it is done or go HERE to get started. Just look for my reply. --Adam #geoevent #realtime #flight #flightaware #tracking #FlightXML #avl #flighttracking
... View more
04-24-2019
09:45 AM
|
0
|
0
|
2665
|
|
POST
|
Hi J molk, So, I was able to make a connection and successfully query our tail numbers in SearchBirdseyeInFlight easily with Postman. Frustrating to say the least when I couldn't get the query that I wanted to work in GeoEvent Server. I just kept plugging away. The key for me was moving to the Post HTTP Method. I was then able to play around with URL Encoding in the Post Body in hopes of finding something that GeoEvent would accept it. It finally works! Anyway - here is what I came up with.... Using Poll an External Website for JSON input: URL stays the same: http://flightxml.flightaware.com/json/FlightXML2/SearchBirdseyeInFlight Another important part - I had to manually create the GeoEvent Definition to match the Parsed JSON based on the JSON object "altitude". Create GeoEvent Definition: No. GeoEvent Definition Name (Existing): [Your Definition Name Here] Note table picture below... HTTP Method: Post Header Parameter Name:Value List: Authorization: Basic [your "username:key" that is Base64 encoded] Post From: Content Body Post Body: I was able to ONLY URL Encode the spaces within the Body to get the result: In my case, the Post Body looked like this: query={ident_or_reg%20{TAIL1%20TAIL2%20TAIL3%20TAIL4%20TAIL5%20TAIL6%20TAIL7%20TAIL8%20TAIL9%20TAIL10%20TAIL11}} In your case, the Post Body might look like this: query={range%20lat%2038.8863%2040.897669}%20{range%20lon%20-79.03655%20-77.1236} Post body MIME Type: text/plain JSON Object Name: aircraft The GeoEvent Definition looks like this: Let me know how you make out - or already figured it out on your own!!! --Adam #geoevent #flight #flighttracking #flightxml #flightaware #firehose #cheaper #faa #avl
... View more
04-24-2019
09:26 AM
|
1
|
1
|
2258
|
|
POST
|
Hi Heath, I don't think that the Track Gap Detector is the item you want to be using. It relies on an initial packet for a reference and then checks every x seconds (Gap Detection Interval) to see if any other packet has been received within the set Gap Duration. So it uses an "internal reference" (it's own time-stamp on the first packet and then every other packet through) to check that there are no "gaps" in your stream - based on your stream's expected delivery rate. AND there is no way to put it in between a Write to FC output and AGOL. For example: I consume lightning data. I connect to that source via a connection with a "Receive Text from a TCP Socket" connector. The feed has a "pulse" that tells us that the feed connection is still alive every 15 seconds if there is no lightning activity in our area. This is usually the weak point in our workflow - the connection between GeoEvent and the remote server. I have a branch of my service that just handles the Gap Detection. It just slims the fields of any packet coming through. The Gap Detector just gives me a True/False - gap or no-gap. (Gap Duration = 60, Gap Detection Interval = 20) I use a gap = "true" filter to send me a text message when the feed goes down, and a gap = "false" filter when the feed comes back up. I would like to make a branch off the "true" filter to also send a command to a script running on the server that stops and starts the input - re-establishing the communications between the remote server and GeoEvent. I am starting to study these two blogs a little more closely for an answer: Scripting tasks using the GeoEvent Admin API Scripting tasks using the GeoEvent Admin API - Update Inputs You might just consider trying a server script that restarts the output every night or twice a day? I might just try that one with my input, but my problem is that my connection sometimes drops many times a day - AND - I don't have a developer. I'd be very interested in hearing how you work through this. --Adam
... View more
03-25-2019
05:06 AM
|
0
|
0
|
1021
|
|
BLOG
|
Hi Allen, I don't know that you need to define the Expected Date Format. Try just connecting to a Text to JSON file output and see what it gives you. Just make sure that the field is Date formatted in the input GE Definition. --Adam
... View more
03-06-2019
08:37 AM
|
0
|
0
|
30504
|
|
POST
|
This is an update to this thread. The FAA has decommissioned the old ASDI feed and has put it within their new SWIM Program - I believe that the TFMS within this chart is the new generation of ASDI. In my opinion, connecting to this system is a highly complex process for the data you get. I'd look to FlightAware ($$) or maybe even the OpenSky Network (possibly free). --Adam geoevent #realtime #faa #flight #flightaware #flighttracking #avl
... View more
02-25-2019
05:53 AM
|
0
|
1
|
2665
|
|
POST
|
Hi Again! So, things have changed for me. For the past two weeks, I have been attempting to build a complex service to reformat incoming AVL packets from one non-standard schema to another. It's a pain in the rear, as companies should realize that when they do this - they make it so complex for their customer unnecessarily - ESPECIALLY since the company never makes ANYTHING that consumes these packets!!!! Standards, Please!!!! Enough of my rant.... So, doing all of this conversion of every field needed - after every step, I attach a JSON or CSV file output to make sure that everything runs as expected. After doing this successfully for around a 51 step process, branched by IF statements, the server runs smoothly. Averaging CPU usage between high teens and low 20s when running. I then attach a Text to External UDP Socket - and the server spikes to 99% or 100% CPU usage. Of note, this process works flawlessly in a GE at 10.3.1. I did not export this one and use it in my current server. I have rebuilt this service 3 times in 10.6.1 and have re-created outputs numerous times. No luck. I do have a few recurring error messages in the log that I have to figure out.
... View more
02-25-2019
05:12 AM
|
0
|
0
|
1854
|
|
POST
|
Allen Scully, I read this, and two things came to mind: Are you running any McAfee products on the server? If so, look at these: https://support.esri.com/en/technical-article/000014907 https://support.esri.com/en/technical-article/000012517 I had this problem at 10.5 or 10.5.1 as I remember. Mine was fixed with a patch of the Enterprise McAfee that was pushed out to all servers. IT would not whitelist specific folders for me. Running GeoEvent with 2 CPUs in a virtual environment. Not really convinced that either of these are contributing especially since this only occurred after updating from 10.5 to 10.6.1. It is not like you decreased CPU count or memory from a previous install. That said, I have never done a 10.5 to 10.6.1 update and I have always needed to get a bit of help from Esri support after an install or update. Just shot-gunning some ideas. I hope you find a solution quickly, --Adam
... View more
01-31-2019
03:35 AM
|
0
|
2
|
1854
|
|
POST
|
Now, if I could just find anyone who has used the live ASDI feed with GeoEvent, I'd be a happy camper! --Adam #geoevent #realtime #faa #flight
... View more
12-12-2018
09:17 AM
|
0
|
0
|
2665
|
| Title | Kudos | Posted |
|---|---|---|
| 2 | 12-09-2019 05:45 AM | |
| 4 | 01-25-2021 05:21 AM | |
| 1 | 10-21-2019 08:14 AM | |
| 1 | 08-26-2019 03:56 AM | |
| 1 | 10-10-2019 08:47 AM |
| Online Status |
Offline
|
| Date Last Visited |
06-23-2021
12:07 PM
|