Origin Destination Matrix with 212.000 origins and 100 destinations

[ClaudiaCosta]

Hi,
I'm trying to do an OD matrix between 212.000 origins and 100 destinations, with each origin going to only one destination.
These origins are nodes in my network and are in a personal database.
However my computer is taking almost 2 minutes to upload 10 origins, so I will need almost 45 days, 24 hours a day, to upload all the origins!
I thought the problem was my computer but the upload operation is only using 16% of my computer capacity and the informatic told me that the problem is that ArcGIS only works with 32 bits.
Can somebody help me with a solution?
thank you!

[MelindaMorang]

Hi Claudia.  It is true that ArcGIS Desktop is a 32-bit application.  However, there are a few things you can do to speed up a very large calculation:

1)  Install the 64-bit Background Geoprocessing product.  This way, when you run ArcToolbox tools in Desktop, if you have background geoprocessing enabled (in Geoprocessing->Options), the tool will run in 64-bit mode, which speeds things up quite a bit.  Note that you have to be running the ArcToolbox version of Solve instead of clicking the little Solve button on the Network Analyst toolbar.  You can also run python script tools using 64-bit background GP by simply calling the 64-bit version of python.  The documentation explains it in more detail: http://resources.arcgis.com/en/help/main/10.2/index.html#//002100000040000000
2)  You can use python�??s multiprocessing module to run several analyses in parallel.  This is extremely helpful if you have a problem that can be broken up into multiple solves.  Setting up the multiprocessing is simple in principle, but it doesn�??t always play well with ArcGIS, so it�??s a bit tricky.

Also, are you using a network dataset you built yourself?  If the network dataset has poor connectivity (lots of roads that are disconnected from one another unintentionally), solves will take longer.  If an origin or destination snaps to a disconnected network segment, the solver might have to search the entire network trying to find a path before it gives up and says there is no solution.

I hope this helps a little.  Good luck.

[JaySandhu]

If your points are taking a long time to load then most likely you are missing a spatial index on your line feature class. Is this a shape file based network dataset? In any case, you should use catalog to look at the street line feature class and see if it has a spatial index and build one if it does not exist.

More on indexes here:
http://resources.arcgis.com/en/help/main/10.2/index.html#//001700000060000000
http://resources.arcgis.com/en/help/main/10.2/index.html#//003n0000001q000000


I suggest that you should run Calculate Locations on your origins and destinations and then use these location fields to load the data into the origin destination analysis layer when needed. More info here:
http://resources.arcgis.com/en/help/main/10.2/index.html#//004800000006000000


Jay Sandhu