Select to view content in your preferred language

How to generate Elevation summary for huge data set in 1 go?

2557
10
03-09-2018 08:17 AM
deleted-user-_D_hZi4SxV2S
Deactivated User

Hi,

I am trying to generate summarized elevation for water pipes using SummarizeElevaion tool. But this tool has a limitation of 1000 records at a time. I have a huge dataset that has more than a 100,000 records. When I feed my dataset to the tool, it fails. Is there any workaround to this problem?

0 Kudos
10 Replies
DanPatterson_Retired
MVP Emeritus

In arcpy, you can use FeatureClassToNumPyArray, just export the field you need to an in_memory workspace without any other fields,  Here is a quick 1 minute example of getting stats for an X field in this case

import arcpy

fc = r"C:\Git_Dan\a_Data\arcpytools_demo.gdb\polylines_pnts"

f_names = [i.name for i in arcpy.ListFields(fc)]

f_names
['OBJECTID', 'Shape', 'ORIG_FID', 'POINT_X', 'POINT_Y']

a = arcpy.da.FeatureClassToNumPyArray(fc, 'POINT_X')

a = a.view(np.float64)  # ---- don't ask... just to make things simpler

a.min(), a.max(), a.std(), a.mean()
(300000.29069999978, 300042.31799999997, 13.524386947645237, 300021.91723809525)

An array of 100,000 is trivial in numpy

0 Kudos