How to deal with ERROR 030096: The maximum records for Origins limit of 1000 has been exceeded In ArcGIS Pro?

1902
9
10-11-2017 02:18 PM
Highlighted
New Contributor II

Hello

I have run "Generate Origin Destination Cost Matrix" in "ArcGIS Pro". But I have got ERROR 030096 telling that the maximum records for Origins limit of 1,000 has been exceeded. The number of origins for my project is nearly 67,000 points, and I don't want to split them into 67 groups; hence I am looking for a way to increase the limit from 1,000 to say 67,000 in ArcGIS pro. 

Thank you in advance

9 Replies
Highlighted
MVP Esteemed Contributor

You will need a field to use SplitByAttributes ....  

You can load this function in the Field Calculator and calculate the grouping in a numeric (long) field.  

Python parser!!!

The key is the seq_group(!OBJECTID!, XXXX) line.  In the example below, if the objected mod 10 equals 0, the sequential 'cnt' value increases, thereby starting a new group of values.

Give it a shot, then split by attributes on that field

cnt = 0
def seq_group(id, val):
    global cnt
    if id % val == 0 :
        cnt += 1
    return cnt
__esri_field_calculator_splitter__
seq_group(!OBJECTID!, 10)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Tested in ArcGIS Pro, should work in ArcMap

Highlighted
New Contributor II

Mr Patterson

Thanks for your prompt response. Your solution could work, but I prefer to increase the limit from 1,000 to 67,000 if there is any way to do that in ArcGIS pro.

Highlighted
MVP Esteemed Contributor

it will break into groups of 1000, if you want groups of 67,000, then change the 10 to 67000

seq_group(!OBJECTID!, 67000)  # 67000 is the number of objects to form one group, could be 10, 100, 1000 whatever

Which means you didn't try it did you?  Once you have it numbered, which you can confirm rapidly, then you splitby attribute on that field you created

Highlighted
New Contributor II

How can I load seq_group function into my Field Calculator? I don't have this function in my Field Calculator . 

BTW, I still prefer NOT to split my origins into groups, and instead I prefer to increase the limit of "network analysis tool" from 1,000 to 67,000 (if there is any way) in order to not get ERROR 030096 anymore.

Reply
0 Kudos
Highlighted
MVP Esteemed Contributor

You either split or reduce your origins... surely some can be aggregated because they are really close together...

If notthis is the only other information, which basically says what we have already covered.

030096: The maximum records for <value> limit of <value> has been exceeded.

Description

The input features or rows cannot be added to the specified network analysis class as the maximum allowed limit has been exceeded.

Solution

Reduce the number of input features or rows that are being added to the specified network analysis class, or if possible, increase the limit.

Highlighted
Esri Regular Contributor

In ArcGIS Pro, the OD Cost Matrix itself does not have a 1000 origin limit. If you have your own local network dataset then you can solve for larger number of origins.

The 1000 Origins limit is imposed when you are using ArcGIS.com to solve this problem. This is a limit imposed on the OD service. How many destinations do you have? If you have a large number of destinations then the size of the computed OD become quite large and hard to transfer that data back. So try to use the splitting it as Dan outlined.

Jay Sandhu

Highlighted
New Contributor II

Thank you very much Mr. Sandhu.

The number of my destinations is around 4,000. Based on your explanation, it seems that there is no way to increase origin limit when using ArcGIS.com for solving the problem.

In case I use my own local network dataset, can I calculate time taken from origin to destination based on existing traffic on the roadway (NOT distance from origin to destination)?

Reply
0 Kudos
Highlighted
Esri Regular Contributor

If your local network dataset has been built with support for live traffic and you are subscribing to a traffic feed then, Yes, you can use it to compute the OD based on a start time. But remember, that travel time (based on real-time traffic) is only valid for that start time.

Jay Sandhu

Highlighted
New Contributor II

If you use ArcMap Network Analysis there is no cost and no limit. I wrote this tutorial for ArcMap GIS/NA.md at master · akell47/GIS · GitHub 

Reply
0 Kudos