If you look at the HTML view, you can inspect the parameters sent with the request. The one that's different is the Quantization Parameters parameter sent with the relevant response.
Ex:
Quantization Parameters = {"mode":"view","originPosition":"upperLeft","tolerance":2.388657133974319,"extent":{"type":"extent","xmin":-7241915.960087257,"ymin":5658078.265584529,"xmax":-7038189.895516766,"ymax":5782130.8860775875,"spatialReference":{"wkid":102100,"latestWkid":3857}}}
From an unrelated API doc, it looks like it creates a virtual grid from the geometry, explaining why you see relevant positions for features:
Query | API Reference | ArcGIS API for JavaScript 4.4