topic Re: ArcGIS Architecture Series: Tools of an Architect in Implementing ArcGIS Questions

ArcGIS Architecture Series: Tools of an Architect

JacobBoyle412 — Mon, 01 Apr 2019 17:36:21 GMT

The Architecture Practice team in Professional Services is pleased to announce a new series leading up to the Esri User Conference. We will be highlighting various tools and best practices for ArcGIS Enterprise implementation and tuning.

System design and architecture can some times feel daunting. As an ArcGIS Enterprise or ArcGIS Server administrator, you may occasionally be faced with decisions for how to best optimize the services within your site for performance, reduce wait-times, and eliminate service down times.

ArcGIS Server Tuning and Optimization with System Log Parser - Outlines configuring ArcGIS Server for System Log Parser analysis and setting up System Log Parser.
System Log Parser - Statistics and Service Optimization - Outlines what specific fields to focus on for service optimization and ways to tune services and the underlying data to optimize performance.
What is eGDB Health - Egdbhealth is a tool for reporting on various characteristics of Enterprise Geodatabases (eGDBes).
Using Egdbhealth to Evaluate a Geodatabase - This article discusses how to use the outputs of egdbhealth to evaluate the health of an eGDB.
Using Egdbhealth in System Design - The primary purpose of the tool is to evaluate the “health” of eGDBes. However, the output can also be used in a system design context. This article addresses the system design use case.
**NEW** Planning Load Balancer Configuration for Highly Available ArcGIS Enterprise - Organizations often require a certain level of system uptime for their ArcGIS Enterprise deployments, such as 99 percent of the time or higher.

Note: The contents presented above are recommendations that will typically improve performance for many scenarios. However, in some cases, these recommendations may not produce better performance results, in which case, additional performance testing and system configuration modifications may be needed.

Implementing ArcGIS‌ ArcGIS Monitor‌ ArcGIS Enterprise‌ Geodatabase

Re: ArcGIS Architecture Series: Tools of an Architect

RyanUthoff — Tue, 16 Apr 2019 17:13:50 GMT

I am trying to configure the System Log Parser and I am getting the following error message:

Could not collect logs! The required Token Service URL was undefined. Please ensure the Token Service URL is defined at https://servername/arcgis/rest/info.

I went to that URL and the Token Service URL is in fact not defined, but I can't find any documentation on how to fix it. How am I able to set the URL so I can get the System Log Parser to work?

Re: ArcGIS Architecture Series: Tools of an Architect

JacobBoyle412 — Tue, 16 Apr 2019 17:35:33 GMT

If you're having issue with accessing your server over port 6443, try running the request through the Web Adapter URL instead. That may resolve this issue, depending on your deployment scenario.

Re: ArcGIS Architecture Series: Tools of an Architect

RyanUthoff — Wed, 17 Apr 2019 12:20:49 GMT

Thank you, that resolved that issue. I am running into a different issue now though.

Using the ArcGIS Server (Web) option works fine for me, but when I use the ArcGIS Server (FS) option to read the logs directly, it often gives me an error message, even when using the same time period when it works successfully with the web option.

I get an error message saying: Could not collect logs! Problem streaming the log (log name). The data from the following line was not in the expected format. It then gives a specific line from the log. I don't immediately notice any issues with the line, it appears to be formatted the same as all of the other lines.

I've experienced the error message above from multiple log files, it isn't just isolated to one instance.

Re: ArcGIS Architecture Series: Tools of an Architect

RyanUthoff — Wed, 17 Apr 2019 19:38:12 GMT

Just to update, I can replicate this on two different deployments of ArcGIS Server.

Re: ArcGIS Architecture Series: Tools of an Architect

JacobBoyle412 — Tue, 23 Apr 2019 17:37:48 GMT

Thanks Ryan,

We're working on a patch to correct this issue. Aaron Lopez‌

Re: ArcGIS Architecture Series: Tools of an Architect

RyanUthoff — Tue, 23 Apr 2019 18:54:38 GMT

That's awesome to hear! Thank you!

Re: ArcGIS Architecture Series: Tools of an Architect

JacobBoyle412 — Tue, 21 May 2019 22:20:45 GMT

Hey Ryan,

Have you downloaded the latest build to see if this resolves your issues?

Thanks!

Re: ArcGIS Architecture Series: Tools of an Architect

RyanUthoff — Wed, 22 May 2019 15:46:35 GMT

Hello Jacob,

I just downloaded the newest build that I see (v0.9.5.0 according to the release notes) and I continue to have the same error message. I'd be more than happy to provide you with any information that you need to help troubleshoot this, just let me know.

Re: ArcGIS Architecture Series: Tools of an Architect

JacobBoyle412 — Wed, 22 May 2019 22:18:57 GMT

Let me bug the team and see when we'll be pushing an update.

Re: ArcGIS Architecture Series: Tools of an Architect

poojagam — Wed, 31 Jul 2019 15:47:44 GMT

I am trying to configure system log parser for azure and passed all required inputs . When I click analyse logs it just display message at bottom of panel "Querying log data.. Please wait.. (0 kb retrieved)" and does nothing

Re: ArcGIS Architecture Series: Tools of an Architect

DianeMcGuerty1 — Wed, 07 Aug 2019 14:37:43 GMT

Hi- Any update for a fix for this issue? I just downloaded the newest version and am still getting the token service url is undefined...

Thanks

Re: ArcGIS Architecture Series: Tools of an Architect

DebbieBull — Thu, 22 Oct 2020 20:57:52 GMT

I would like to run EGDBHealth on a schedule, is there a command-line interface for it?..and a reference document for syntax?

Re: ArcGIS Architecture Series: Tools of an Architect

DannyKrouk — Tue, 10 Nov 2020 03:44:19 GMT

There is a command-line interface to egdbhealth. It is described in the documentation that comes with the download. While I've not found an occasion to schedule it, I know of people who have. So, it is certainly do-able. If you run into challenges, feel free to email me (my address is in the documentation). 🙂

Re: ArcGIS Architecture Series: Tools of an Architect

Anonymous User — Mon, 23 Nov 2020 14:38:14 GMT

I'm currently unable to download any content from the ArcGISMonitorTeam, including egdbHealth.

Re: ArcGIS Architecture Series: Tools of an Architect

MarkChilcott — Tue, 24 Nov 2020 04:10:30 GMT

Hi,

I have run the System Log Parser. On the Request Performance Tab for the Top 500 slowest requests I see a lot of /legend requests. When I send a REST /legend request to the service, it responds well.

Any idea what may be causing this? Could it be an app like ArcGIS Pro?

Cheers,

Mark

Re: ArcGIS Architecture Series: Tools of an Architect

SH013 — Sat, 20 Feb 2021 22:50:06 GMT

Hi there, I recently ran the System Log Parser and encountered the following error message "Could not collect logs! ArcGIS Log Query Error: Could not send HTTP request https://gisserver.domain.com/server/admin/logs/query Reason: equest Execution Time: 300.04 second (see attachment for reference).

I also received a warning message from the System Log Parser that the log collection attempt could not be completed. Please check inputs. ArcGIS Log Query Error: Could not send http request.

Any idea what could be causing this problem? The System Log Parser is working in another independent environment of ours, but not this particular one.

for some reason it would start querying log data and ask me to wait and then get stuck at 3168kb retrieved before timing out.

Thanks in advance!

Re: ArcGIS Architecture Series: Tools of an Architect

JacobBoyle412 — Tue, 06 Apr 2021 15:03:38 GMT

We've pushed out an update on March 8, 2021. Please re-download and let us know the result.

If you are having further issues, please use the ArcGIS Server (FS) button and point the tool at the file location of your logs.

Re: ArcGIS Architecture Series: Tools of an Architect

AnthonyRyanEQL — Wed, 28 Feb 2024 20:52:03 GMT

Is there a blog/post on the information that System Log Parser generates could be achieved using another system that ingests the server log files (eg. Dynatrace, ELK).

We currently use Dynatrace with server metrics (eg. CPU, RAM) and going to expand into log ingestion in the near future and would like to use 1 system if possible to gain insight at the various aspects of the system (eg. system utilization, performance, health, etc)

If not, is the System Log Parser source code available?

Re: ArcGIS Architecture Series: Tools of an Architect

DavidHoy — Wed, 28 Feb 2024 23:02:00 GMT

Hi Anthony,
it is certainly possible to use other tools that achieve the same outcomes as SLP.
It gathers information from the Server logs either by making repeated calls to the REST endpoints or by directly reading the log files themselves.
The magic is in how the raw information is turned into useful statistics.
I would say it is not reasonable to ask for the source code for how this is done.
You would need to gather log start transaction and end transaction records grouped by transaction-id and do the maths for the duration.
Then collate a table/dictionary of all transactions and retrieve the various statistics
- time of day, duration, success/error codes, etc

then use this dictionary to create useful reports.

or, you could write code that calls SLP.exe to gather the stats and report with your dashboard tool - that's how ArcGIS Monitor does it

Good luck in your endeavour