topic Re: Is there a limit to API calls? in ArcGIS API for Python Questions

Is there a limit to API calls?

ThomasColson — Thu, 29 Aug 2019 12:26:22 GMT

I'm using https://community.esri.com/thread/239341-find-all-content-for-all-users-in-an-agol-subscription-parse-results?sr=inbox to pull some statistics, but I'm finding the output limited to 10000 rows, and I know we have more than 10000 items.

Re: Is there a limit to API calls?

ThomasColson — Thu, 29 Aug 2019 12:36:11 GMT

Or a better way to ask this:

Is there a way to specify date ranges in gis.content.search ?

I see https://community.esri.com/thread/224718-arcgis-api-for-python-find-latest-items there is a way to go back so many days, what I'm after is a way to specify a between range, say, I want every item created from 2014-2016, which would allow me to do multiple queries under the 10000 item limit, then concatenate the results.

Re: Is there a limit to API calls?

JoshuaBixby — Thu, 29 Aug 2019 13:10:17 GMT

The simo xu‌ response to the thread you reference appears to answer your question, albeit using "now" for one of the date ends. Have you tried that code just with different dates?

Re: Is there a limit to API calls?

ThomasColson — Thu, 29 Aug 2019 13:18:08 GMT

err....ahhhh....I'm "trying". Not the brightest python bulb in the room here. When you say hard code the now part, would that be

now = someunixtimestamp

Re: Is there a limit to API calls?

ThomasColson — Thu, 29 Aug 2019 13:35:24 GMT

So I've tried:

now = '1567084745'
then = '1546300800'

itemsList = gis.content.search('uploaded: [' + then + ' TO ' + now + ']', max_items = 10000000)
itemsList = gis.content.search('created: [' + then + ' TO ' + now + ']', max_items = 10000000)

And both return nothing

Re: Is there a limit to API calls?

JoshuaBixby — Thu, 29 Aug 2019 13:44:35 GMT

Make sure you are working in milleseconds. Search reference—ArcGIS REST API: Users, groups, and content | ArcGIS for Developers :

The created field contains the date and time an item is created in UNIX time. UNIX time is defined as the number of seconds that have elapsed since midnight January 1, 1970. The portal stores time in milliseconds, so you need to add three zeros to the end of the UNIX time.

Re: Is there a limit to API calls?

ThomasColson — Thu, 29 Aug 2019 14:31:30 GMT

So here's what ended up working:

itemsList = gis.content.search(query = 'created: [1559394001000 TO 1567086853000]', max_items = 10000000)

But now I'm running into another road block: we create a lot of content! I originally went back to Jan of 2019, which still put me against the 10000 item throttle limit. So chunking this up into 6-month calls is a little time consuming, as I need to go back to 2010.