POST
|
I've been seeing an error in our GeoEvent logs that states "ACCESS_REFUSED - Login was refused using authentication mechanism PLAIN". The error is related to our server's message bus platform service. The error usually starts showing up after our server reboots but we sometimes are able to connect after a normal startup procedure. We are able to fix the issue by stopping the message bus and then restarting it but this process can and usually takes 5 or more attempts. We updated our startup routine so that the Gateway waits to start until two minutes after ArcGIS Server and GeoEvent waits until two minutes after the Gateway has started. The issue still persists after adjusting the startup procedure. These seems tricky to pinpoint as restarting the message bus enough times will resolve the issue. The logs are also throwing two errors related to an "unexpected connection driver error" and one from RabbitMQ that states "the trust manager trusts every certificate, effectively disabling peer verification". I've attached a snapshot of the logs. We are running 10.6.1.
... View more
03-13-2020
02:25 PM
|
0
|
2
|
1107
|
POST
|
Wanted to chime in on this thread as we've found a suitable resolution. We have a number of outputs that stop working after rebooting our server. We limit our server maintenance windows but we still have about one reboot per month. The reboot causes certain processes to stop working once GeoEvent Server is back up. We've been able to keep our outputs working by running two scripts when a reboot is initialized. The first script basically turns off a service's outputs, inputs and self in that order. That script is run prior to restarting the server. The second script turns everything back on once the reboot has finished. We haven't identified all the outputs that break when a reboot is initialized but these steps do keep the email output working. The scripts themselves are created in Python and run from Task Scheduler (start services) and the Group Policy Manager (shutdown, stop services). The shutdown script runs from a .BAT file.
... View more
03-11-2020
09:38 AM
|
0
|
0
|
609
|
POST
|
Wanted to chime in on this thread as we encountered similar issues and figured out a suitable resolution. We have a number of outputs that stop working after rebooting our server. We limit our server maintenance windows but we still have about one reboot per month. The reboot causes certain processes to stop working once GeoEvent Server is back up. We've been able to keep our outputs working by running two scripts when a reboot is initialized. The first script basically turns off a service's outputs, inputs and self in that order. That script is run prior to restarting the server. The second script turns everything back on once the reboot has finished. We haven't identified all the outputs that break when a reboot is initialized but these steps do keep the email output working. The scripts themselves are created in Python and run from Task Scheduler (start services) and the Group Policy Manager (shutdown, stop services). The shutdown script runs from a .BAT file.
... View more
03-11-2020
09:36 AM
|
0
|
1
|
1208
|
POST
|
Our servers had to get rebooted over the weekend and I noticed GeoEvent started to log a number of errors once the reboot happened. The reboot only affected our dev environment which doesn't have an email service. The error logs were mostly pointing at the message bus service. I was able to resolve the issue by restarting the message bus a few times. I have heard others describe similar issues with 10.6.1 and it seems like the common resolution is to restart services or GeoEvent itself. I have read some threads that recommend starting geoevent and the gateway with a delayed state (delayed start). It seems like the long term resolution might be to ensure our environment conforms to ESRI's recommendations and standards. I don't believe we can prevent the servers from getting rebooted since they are subject to monthly service updates but we should be able run a Python script that restarts services on reboot.
... View more
02-18-2020
09:32 AM
|
0
|
0
|
609
|
POST
|
I built a couple applications using the Web App Builder Developer Edition. I deployed each application to our server and registered each with our Portal. I'm able to successfully login to both applications from Chrome using our enterprise logins. However, one of the apps redirects in IE11 to the Portal's homepage. The other app redirects correctly in IE. The issue with IE appears to be related to the popup window not displaying in IE. IE normally throws a popup with a message asking if I want to "close the pop up". The page normally redirects to the app once I close the popup. Anybody experience similar issues with IE or know of possible resolutions?
... View more
02-18-2020
09:11 AM
|
0
|
0
|
297
|
POST
|
After doing a bit of research, I think we can design around this issue by bumping our minimum feature service instances up to two. Does that sound correct?
... View more
01-31-2020
10:18 AM
|
0
|
0
|
535
|
POST
|
We have a GeoEvent Service that accepts input as JSON on REST endpoint and then adds that input to an ArcGIS Server Feature Service. Our Feature Service recycles its configuration every 24 hours starting at 00:00 hours. I am wondering how the GeoEvent Service will handle messages received while the feature service is being recycled. Our GeoEvent Input will still return a status 200 since it received the JSON payload but I am wondering if the insert will fail due to the service being unavailable or will the GeoEvent Service save the event and iteratively try another call? I imagine we can design the integration to account for this but it would be added work for our integration team. Wondering if anybody has any experience dealing with this issue or any advice? Thanks in advance.
... View more
01-31-2020
10:04 AM
|
0
|
2
|
590
|
POST
|
So it appears we have identified what is causing our email service to stop working. Our servers get rebooted from time to time for various maintenance and patching. The reboot causes certain processes in GeoEvent to stop working. We currently know how to resolve the issue but we don't know how to prevent it. We have a failover process in place though I believe that requires us to make manual updates to our enterprise config for various components of our infrastructure. We are working on setting up a truly HA environment and that will hopefully prevent this issue from surfacing in the future. That said, I would still appreciate any helpful responses from the community.
... View more
01-24-2020
03:09 PM
|
0
|
1
|
1242
|
POST
|
Noticed another thing. Our actual box where GeoEvent is installed got restarted at 8:45AM on 1/18/2020. Our service sent its last email at 8:09AM on the same day.
... View more
01-24-2020
11:36 AM
|
0
|
0
|
1242
|
POST
|
So I did notice something in the logs that might provide a clue. I created of copy of the original email output and added that to my geofencing service. I then created a test service with the original email. The geofencing service is sending the emails out and the test service is still not working. The pic below shows what the logs return when I start all the inputs, outputs and services for the two services. Notice how there are two "SUCCESS" messages. Everything below each success message pertains to a specific service. The logs at the bottom (bellow the second SUCCESS message) all pertain to the geofencing service that is working correctly. The test service logs are all nested below the SUCCESS message at the top. Now notice how the service that is working shows four logs that state "Route..... started and consuming from direct://". The test service only shows two of those logs. These logs belong to the logger "org.apache.camel.blueprint.BlueprintCamelContext". Could the error be related to this discrepancy?
... View more
01-24-2020
10:41 AM
|
0
|
1
|
1242
|
POST
|
We are experiencing a similar issue with the send email output connector. The service works for about a month and then stops. The current resolution involves cloning the output and replacing the old one with the new one. Not a long term solution for us since we need a reliable output that won't fail and need to be reconfigured. I've read a lot of threads describing similar defects. We are also running 10.61 with plans to migrate to 10.7 in the coming months.
... View more
01-23-2020
12:56 PM
|
0
|
0
|
402
|
POST
|
Than, I added a new email output and configured it with the exact same properties as the original. I replaced the original one with the updated output and the service is now sending emails. I have placed the original email connector into a new service and it doesn't appear to be working. I'm going to continue trying to resolve the issue as we need a stable output that doesn't have to get reconfigured. Do you have any suggestions based on the updated information I have provided? I think the issue might be related to the Kafka service but my overall knowledge of GeoEvent Server is somewhat limited at this time. I can tell you that the connector stopped sending emails on a Saturday and there shouldn't have been any changes made at that time. Also, I tried checking the logs with the setting set to debug. There was an awful lot of data to sift through in the logs but I wasn't able to locate anything directly related to the email connector.
... View more
01-23-2020
12:20 PM
|
0
|
0
|
1242
|
POST
|
I encountered a similar issue with the send email output. The service shows the output increment but the output connector count is not increasing. I reconfigured the email connector with a new output. The new email has the exact same properties as the original and the service is working again. I placed the original email connector into a new test flow and it still doesn't work. I suspect the issue might be due to one of the controlling processes getting restarted after the output connector was running. Restarting the output doesn't seem to resolve the issue. We are running 10.61 with plans to migrate to 10.7 in coming months.
... View more
01-23-2020
12:11 PM
|
0
|
2
|
1208
|
IDEA
|
From what I have read Portal and AGO only support On Demand mode for feature layers. It would be nice if we could load layers in snapshot mode so that we could reduce the amount of queries we send back to our server. Furthermore, it would be nice if the supporting widgets worked off data stored in the DOM rather than always sending queries back to the server. I understand snapshot mode works best when there are relatively few features to draw but most maps seem to meet that requirement. This would also lower the load on service requests in ArcGIS Server. Selection mode would be great as well. We have found selection mode to work nicely when we are working with very large temporal datasets. We have successfully loaded layers in Portal maps in selection mode but we are forced to add them in programmatically.
... View more
01-22-2020
11:33 AM
|
0
|
0
|
309
|
POST
|
Than, I appreciate the response. Are you aware of what the underlying issue was with the STBDS connector? I understand reconfiguring the service or restarting it might provide a temporary resolution but my organization will have to seriously consider our use cases for GeoEvent Server if these techniques are the approved way to go about fixing defects. Again, I appreciate you taking the time to respond.
... View more
01-22-2020
10:07 AM
|
0
|
2
|
1242
|
Title | Kudos | Posted |
---|---|---|
1 | 06-07-2022 11:44 AM | |
1 | 03-11-2021 12:25 PM | |
1 | 06-28-2022 06:45 AM | |
1 | 03-26-2021 06:57 AM | |
1 | 03-26-2021 06:35 AM |
Online Status |
Offline
|
Date Last Visited |
3 weeks ago
|