Implementing ArcGIS Blog

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Other Boards in This Place

Latest Activity

(164 Posts)
AaronLopez
Esri Contributor

Cached map services are a popular and recommended way to provide a fast performing presentation of static data. When map services are cached, the server draws the data at a set of map scale levels you define and saves the images. Then, as the server received requests for the map, it is much quicker (and requires less CPU resources) to retrieve the pre-created cached images than it is to dynamically draw the map again. This is the benefit of cached map services.

Generally speaking, cached map services can support simultaneous requests from many users. Such services can scale well. Despite this well known performance characteristic, it is still a common requirement to load test a cached map service to see first-hand how it behaves and scales on the hardware of a particular ArcGIS Enterprise deployment.

This Article contains a walk-through for load testing a cached map service with an Apache JMeter Test Plan. The examples use a public accessible dataset. Using datasets in Coordinate Systems other than WGS 1984 Web Mercator Auxiliary_Sphere (WKID: 3857) should work, but the generated test data will be based on a WKID of 3857.

Table Of Contents

  • Why Test a Cached Map Service?
  • Cached Map Service Testing Challenges
  • How to Test a Cached Map Service?
    • The Natural Earth Dataset
    • Test Data Generation
      • The Generate Bounding Boxes (Precision) Tool
      • Visualizing the Generated Data in ArcGIS Pro
      • Visualizing the Generated Data in a Text Editor
  • The Cached Map Service Test Plan
    • Components of the Test Plan
      • CSV Data Set Config
      • Levels Of Detail List Logic
      • GetMapTile Logic
      • Cache Tile Loop and Path Population
        • Loop Controller
        • Counter
        • JSR223 Sampler
        • HTTP Request
  • The Thread Group Configuration
  • Validating the Test Plan
    • Transactions
    • Requests
  • Test Execution
  • JMeter Report
    • Throughput Curve
    • Performance Curve
  • Final Thoughts
    • Additional Items Worth Mentioning
    • Assumptions and Constraints
Read more...

more
0 1 67
AaronLopez
Esri Contributor

Network Analyst has always been in-demand capability of ArcGIS Enterprise as it provides popular problem solving analysis types such as Route, Service Area, Closest Facility and Origin-Destination Cost Matrix.

This Article contains a walk-through for load testing a route solver service (map-based service) with an Apache JMeter Test Plan. It uses a public accessible dataset in the examples for the data generation and test configuration process. However, the testing procedure should work when using any valid network dataset. This Article assumes you are familiar with Apache JMeter and some of the Test Plan strategies we have been using in other discussions.

 

Table Of Contents

  • Network Analyst Route
  • Load Testing a Network Analyst Route Service
  • How to Test a Network Analyst Route Service?
    • Network Analyst ArcGIS Pro Tutorial Data
    • Test Data Generation
      • Making the Tools Available from ArcGIS Pro
      • Launch the Generate Data (Solve Route) Tool
      • The Generate Data (Solve Route) Tool Inputs
      • Spatially Visualize the Generated Points
  • The Route Solver Test Plan
    • HTTP Request
    • The Thread Group Configuration
  • Validating the Test Plan
    • Transactions
    • Requests
  • Test Execution
  • JMeter Report
    • Throughput Curve
    • Performance Curves
  • Final Thoughts
Read more...

more
0 0 330
DannyKrouk
Esri Contributor

If you have a multiple-machine Portal for ArcGIS or ArcGIS Server site, you have a dependency on a file share.  If you are having a problem with your site, how do know whether the file share might be causing it?  This article is intended to help with that challenge.

Read more...

more
15 0 1,807
AaronLopez
Esri Contributor

While we have talked about constructing JMeter tests and provided several samples, we have not yet shared how to generate test data, which is half the battle of creating a good test. However, I am excited to talk about a set of load testing tools for ArcGIS Pro that has recently been released that does exactly that.
This free utility is available now and called: Load Testing Tools.
 
One of my favorite tools in this set is "Generate Bounding Boxes" which can quickly and easily generate bounding boxes by the either the map's current extent or a selected polygon...very powerful. The generated data can be visually validated via separate feature classes (one for each map scale) and plugged right into an Apache JMeter Test Plan (via CSV files that are also created).
 
Table Of Contents
  • What is Test Data?
  • Tools for Creating Custom Load Data
  • Creating Custom Test Data
    • Using A Polygon to Outline the Area of Interest
    • Generate Bounding Boxes Tool Inputs
    • Visualizing the Generated Data from the Individual Feature Classes
    • Visualizing the Generated Data from the Individual CSV Files
  • Using the Generated Data in an Apache JMeter Test Plan
    • CSV Data Set Config

 

Read more...

more
4 2 944
AaronLopez
Esri Contributor

The load testing of ArcGIS Enterprise can be carried out using a variety of different tools like: JMeter, LoadRunner or Silk Performer. While all test tools essentially perform the same task of applying pressure to a particular resource and measuring its impact, having a listing of the meanings to common phrases can help ensure testers and analysts are on the same page.

This resource provides insight into some testing fundamentals that are mentioned in other Community Articles about performance and load testing of ArcGIS Enterprise. The vocabulary definitions are listed from a chronological point of view. It all starts with a request so this is the first item discussed.

Read more...

more
0 1 524
AaronLopez
Esri Contributor

Performance Engineering: Load Testing ArcGIS Enterprise

Performance Engineering is the practice of proactively testing, monitoring and analyzing an ArcGIS Enterprise deployment or application from the perspective of performance and/or scalability. System performance and scalability are critical factors in the successful adoption, operation, and long-term use of an ArcGIS Enterprise deployment.  They are often key determinants of end-user satisfaction.

From this post can link you to all of our Articles related to strategies and practices with Load Testing ArcGIS Enterprise.

Read more...

more
1 0 1,048
AaronLopez
Esri Contributor

Apache JMeter is an open source Java software program for performance and scalability load testing. It is a free tool with GUI and command-line support for Windows, Linux and MacOSX that has many enterprise-level features.

This Article contains a walk-through for taking a SampleWorldCities map service Test Plan (created from previous a Article) and discussing how it can be extended to support ArcGIS Enterprise Authentication. It assumes you are familiar with Apache JMeter and some of the Test Plan strategies we have been using in other Articles. For a refresher, please see: 

Table Of Contents

  • Why Add Authentication to a Test Plan?
  • Getting Started
  • Creating the sampleworldcities4 Test Plan
  • Extending the Test Plan to Add Authentication Support
    • User Defined Variables
    • Authentication Requests to Acquire a Token
      • OAuthState HTTP Request
      • OAuthState Regular Expression Extractor
      • AccessToken HTTP Request
      • AccessToken Regular Expression Extractor
      • Token HTTP Request
      • Token Regular Expression Extractor
      • Token Response Assertion
    • Token Support in the Map Request Headers
  • Validating the Test Plan
Read more...

more
2 0 1,020
AaronLopez
Esri Contributor

Apache JMeter is an open source Java software program for performance and scalability load testing. It is a free tool with GUI and command-line support for Windows, Linux and MacOSX with many enterprise-level features.

This Article contains strategies and procedures for running a Test Plan against an ArcGIS map service using the command-line mode in Windows. It assumes you are familiar with some of the basic JMeter Test Plan concepts. If you are new to Apache JMeter, please see our Performance Testing with Apache JMeter (An Introduction)

Table Of Contents

  • Why Run Test Plans from Command-line mode?
  • Verifying the Pre-Test Checklist
  • Batch Script Walkthrough
    • Variables
      • Memory
      • JMeter and Project Paths
      • Test Execution and Switches
    • Putting It All Together
  • Running the Load Test
  • Test Artifacts
  • Preparing for Analysis
Read more...

more
0 0 2,148
AaronLopez
Esri Contributor

Apache JMeter is an open source Java software program for performance and scalability load testing. It is a free tool with GUI and command-line support for Windows, Linux and MacOSX with many enterprise-level features.

This Article contains strategies and procedures for creating a dynamic load test against an ArcGIS Server service and validating the response. It assumes you are familiar with some of the basics of Apache JMeter. If you are new to Apache JMeter, please see our Performance Testing with Apache JMeter (An Introduction)

Table Of Contents

  • Prerequisite
  • JMeter Testing Strategies
    • A Good Test Plan Starts with a Proper Folder Structure
    • User Defined Variables
    • Choosing the Right Thread Group
      • Adding Support for Custom Thread Groups into JMeter
    • Using Transactions to Group Requests
    • Validate the Response is Being Returned
  • Creating a Data Driven, Export Map Test in JMeter
    • Create and Save a New Test Plan
    • Adding Variables to the Test Plan
    • Adding the bzm – Concurrency Thread Group to the Test Plan
    • Adding a Transaction to a Test Plan
    • Adding an HTTP Request
    • Making the HTTP Request Dynamic
    • Adding a Response Assertion
    • Adding a CSV Data Set Config
  • Validating the Test Plan
    • Saving Recent Changes
  • Preparing to Run the Load Test

 

Read more...

more
2 8 2,332
AaronLopez
Esri Contributor

Apache JMeter is an open source Java software program for performance and scalability load testing. It is a free tool with GUI and command-line support for Windows, Linux and MacOSX with many enterprise-level features.

This Article will step you through the installation and setup of an Apache JMeter environment on Windows. Additionally, it will cover how to construct a very basic performance test that requests a static resource and how to visually validate the responses coming from the remote server.

Table Of Contents

  • What is Apache JMeter?
    • What can I do with it?
      • JMeter Behavior
    • Why do I need it?
      • Performance Testing
      • Scalability Testing
  • Installing Apache JMeter
    • Grab the Latest
    • OpenJDK or Oracle JDK?
    • Installing the Plugins Manager
  • Running JMeter (GUI)
  • Creating a Very Basic, Static Test Plan
  • Validating the Test Plan

 

Read more...

more
0 0 1,741
42 Subscribers