Running analyst on subset of the data

503
3
04-10-2019 06:07 AM
ModyBuchbinder
Esri Regular Contributor

Hello all

We have 10M points saved in csv files and used for GeoAnalytics commands.

I would like to run a command that does not have query as one of the parameters (for example Calculate Density) on subset of the points (for example the density of points with type=1).

I could create a new layer by the GeoAnalytics commands that will have only these points and do the analysis on it but that will required to copy all the type=1 points into the spatial temporal for each query (so duplicates data for each query).

Is there any way to do it dynamically (some kind of Make Feature Layer)?  Maybe put it into the manifest or anything like it?

Thanks

Mody

0 Kudos
3 Replies
SarahAmbrose
Esri Contributor

Hi Mody Buchbinder‌,

Currently there isn't a way to set a filter on big data file shares when running tools through ArcGIS Pro (ENH-000118129) or your portal Map Viewer (ENH-000116581). 

But, filters are supported at the GeoAnalytics level by supplying them through REST - so you can definitely apply filters to your analysis that way.  As you mentioned, Copy to Data Store in the Pro UI also exposes the filter parameter (and Find Similar Locations). 

For example:

{"url" : "https://myportal.domain.com/server/rest/services/Hosted/hurricaneTrack/FeatureServer/0", "filter": "Month = 'September'"}

Sarah Ambrose

GeoAnalytics Product Engineer

0 Kudos
ModyBuchbinder
Esri Regular Contributor

Hi Sarah

Thanks for the answer.

I use as input my BigDataStore and I cannot find the correct URL for it

I tried

https://MyPortal.domain.com/arcgis/rest/services/DataStoreCatalogs/bigDataFileShares_mody/cars

but I get invalid input parameter error.

Thanks

Mody

0 Kudos
SarahAmbrose
Esri Contributor

Hi Mody Buchbinder‌,

You'll want to turn on debug to see the cause of the invalid input. That will help figure out if there is an issue with your query. 

The format of the input should look like this 

{"url":"https://machine.domain.com/gax_web_adaptor/rest/services/DataStoreCatalogs/bigDataFileShares_pyTest/...", "filter":"fieldname > 10"}

Thanks,

Sarah

0 Kudos