Errors when trying to work with 705,000 records

Question

I’m working in Insights 2.2.1 for ArcGIS Enterprise 10.6, I connect to database table in SQL Server 2016, this table has 705.000 records. When I try to explore data in a map card (enable location), the system shows me a message “The dataset contains too many records: Try reducing the size of your dataset by filtering it or adding less than 100.000 entities”. I try to adding the same data as Excel or CSV, the system return message “Error loading the file. A maximum file size of 100 MB is allowed”. As last choice I publish the table as service of points (feature layer hosted), add in a map card and the system try to work but show a message “An error has occurred”.

The question:

How can I take advantage of Insights for ArcGIS if I can’t work with 705.000 records?

What do you advise me?

Thanks,

Edward S.

Error_3.png

Error_2.png

Error_1.png

Finally results.JPG

HenryLindemann_6-1646112356419.png

HenryLindemann_5-1646112315020.png

SteveLewis · Answer

I would connect to a View in SQL Server and that has a query that pre-aggregates your data.  You can also get it to join your data back to a point or polygon after the query is complete.  Let the SQL Server optimizer do the work.

SELECT SHAPE, REP_AREA as ReportingArea, Neighborhood, c.* FROM hex_10Meter AS A INNER JOIN (SELECT Hex_ID, Sum(Total_Tons) AS Tons,  FROM Maps_CPN_Hex20 GROUP BY Hex_ID) AS C ON A.Hex_ID = c.Hex_ID

Edward_RodrigoSanchez · Answer

Hi Akshay,

I don’t continue reviewing the topic, I worked with the points service and modified the properties in ArcGIS Server. At that time, it worked to resolve the client's request.

Thanks for your attention.

Akshay Harshe · Answer

Hi Edward,

Are you still experiencing this issue?

I am guessing your were enabling location by addresses.. Have you tried a newer version of insights (2.3)? Also in 3.0 it should work. Note that this will consume credits for geocoding.