topic Re: threading vs multiprocessing for concurrent gp tool runs in Python Questions https://community.esri.com/t5/python-questions/threading-vs-multiprocessing-for-concurrent-gp/m-p/582362#M45655 <HTML><HEAD></HEAD><BODY><SPAN>Thanks Jason. Its not much to switch between the two so Ill change over to multiprocessing.</SPAN></BODY></HTML> Mon, 25 Nov 2013 19:42:10 GMT ChrisMathers 2013-11-25T19:42:10Z threading vs multiprocessing for concurrent gp tool runs https://community.esri.com/t5/python-questions/threading-vs-multiprocessing-for-concurrent-gp/m-p/582360#M45653 <HTML><HEAD></HEAD><BODY><SPAN>If I want to run 15 spatial joins at the same time, would it be better to use threading or multiprocessing? I've implemented threading already in a test and it cut 50 minutes (running sequentially) down to 15 minutes (running in concurrent threads). What is best practice in this case? Threading seems to work just dandy but if its not the recommended module for concurrent processing with ArcGIS I'll make the minor changes needed.</SPAN></BODY></HTML> Mon, 25 Nov 2013 19:14:07 GMT https://community.esri.com/t5/python-questions/threading-vs-multiprocessing-for-concurrent-gp/m-p/582360#M45653 ChrisMathers 2013-11-25T19:14:07Z Re: threading vs multiprocessing for concurrent gp tool runs https://community.esri.com/t5/python-questions/threading-vs-multiprocessing-for-concurrent-gp/m-p/582361#M45654 <HTML><HEAD></HEAD><BODY><SPAN>If threading works for you, stick with threading. I'd recommend multiprocessing over threading, though, for the following reasons:</SPAN><BR /><BR /><UL><BR /><LI>ArcObjects instances (and therefore most arcpy/arcgisscripting objects) cannot cross thread boundaries. That is, if you create an object in one thread, you cannot access it in another.</LI><BR /><LI>On 32 bit operating systems, each individual process gets its own memory space, allowing each to consume a full 2(-4) gigs without having to share with other tool calls.</LI><BR /><LI>Robustness. If one process crashes, the others continue to run and you can restart the one that failed.</LI><BR /><LI></LI><BR /></UL></BODY></HTML> Mon, 25 Nov 2013 19:26:20 GMT https://community.esri.com/t5/python-questions/threading-vs-multiprocessing-for-concurrent-gp/m-p/582361#M45654 JasonScheirer 2013-11-25T19:26:20Z Re: threading vs multiprocessing for concurrent gp tool runs https://community.esri.com/t5/python-questions/threading-vs-multiprocessing-for-concurrent-gp/m-p/582362#M45655 <HTML><HEAD></HEAD><BODY><SPAN>Thanks Jason. Its not much to switch between the two so Ill change over to multiprocessing.</SPAN></BODY></HTML> Mon, 25 Nov 2013 19:42:10 GMT https://community.esri.com/t5/python-questions/threading-vs-multiprocessing-for-concurrent-gp/m-p/582362#M45655 ChrisMathers 2013-11-25T19:42:10Z