Read Feature Services Faster
A recent (at writing) release of the Esri ArcGIS Connector package quietly delivered a significant benefit for people working with ArcGIS Online or Enterprise feature services - namely concurrent read requests.
This matters for people doing things like change data capture (aka change detection) for current and revised editions of a dataset ahead of writing the delta transaction - you can read the current state of the data faster.
How much faster? Let me show you - there are two parts to the story, read request size and the new concurrency behavior. Inspect the workspace annotation and translation log messages in two sessions reading the same service layer:
First, the default situation before the recent package upgrade:
And the same data after the package upgrade:
Like they say, your mileage may vary, but in my case a hosted point feature layer in ArcGIS Online went from reading the feature service of 1.044M features at 3,295 features per second to 12,533 features per second - over 3 1/2 times faster! Partly this is the effect of setting the Features Per Request reader parameter to the maxRecordCount value allowed for the service layer (typically 2000), but in addition the new concurrency of underlying Query REST calls.
Here is a workspace that shows the round trip, reading a CSV file at a URL with new data, reading the feature service, performing change detection between the two and writing the delta transaction to the feature service, the whole process in 3 minutes 10 seconds with the actual writing the delta transaction 5 seconds.
If your Esri ArcGIS Connector is earlier then 3.24.0 then upgrade now and enjoy the performance!
