Using API doesn't return all data

Question

Hi, I'm trying to use the API in python to get all wildfires from this source - https://data-nifc.opendata.arcgis.com/datasets/nifc::wfigs-interagency-fire-perimeters/about (they use esri for their API). In the details it shows there are 27,977 rows. On the right side, after scrolling down on their page slightly, it shows

View API Resources

and I'm using the GeoJSON URL.

When I use this in python, doing something like this,

import geopandas as gpd
import requests
import os
url = "https://services3.arcgis.com/T4QMspbfLg3qTGWY/arcgis/rest/services/WFIGS_Interagency_Perimeters/FeatureServer/0/query?where=1%3D1&outFields=*&outSR=4326&f=json"
cur_path = os.path.abspath(os.getcwd())
local_filepath = os.path.join(cur_path, 'wildfires.shp')
resp = requests.get(url, stream=True)
resp.raise_for_status()
chunks_iter = resp.iter_content(chunk_size=1024 * 4)
with open(local_filepath, 'wb') as file:
    for chunk in chunks_iter:
        file.write(chunk)
df = gpd.read_file("wildfires.shp")
df.shape # Returns (2000, 121)

I'm only getting 2000 rows returned when there should be ~28,000 rows. Does anyone know what the issue might be here?

Thanks!

bixb0012 · Accepted Answer

Look at the layer's property page, it states "Max Record Count: 2000", which is typical.  You will need to make multiple calls to retrieve all of the data.  You should read the REST API documentation about how to use the Result Offset and Result Record Count parameters.