GPU not working

[AdrienMichez]

Hi,

I'm trying to use GPU capabilities to train a deep learning model in arcgis pro using the 'train deep learning model' tool. I used the msi installation to install deep learning capabilities. It's working fine but is so slooooooow!

From other posts, I checked that Cuda is properly installed and that the python command  torch.cuda.is_available() returns True.

I've activated GPU in environment/processor type but looking at task manager, my GPU does not seem to work hard, neither the CPU's.

I also check with the nvidia-smi monitoring tool which confirms that no running processes are found:

I'm using a GeForce GTX 770. Maybe this model is not compatible? It's not brand new nvidia

Best regards

Adrien

[PavanYadav]

@LeonelRivero_79 

About #1, are you considering using the deep learning tools to detect objects as a GP service. While I'm not a web application expert, I'll consult with my colleagues for more insights.

About #2, we need to assess whether 15 hours is a reasonable processing time given the amount of data, GPU vRAM, and batch size you're using. The tips I shared in my previous post can help narrow down this. Are you seeing an optimal level of GPU vRAM utilization (greater than 80%)? If not, try increasing the batch size. If vRAM utilization is already close to 100%, consider increasing the GPU's vRAM. You can also use multiple GPUs on the same machine or scale up processing using ArcGIS Enterprise if this is something you would to often. (thinking about return on investment). If you're using ArcPy outside of ArcGIS, ensure that arcpy.env.processorType is set to 'GPU'. (by default the tool should use available supported GPU, but just in case you can try with and without if it is an issue)

About #3, please make sure the batch size is not too small. if you were using 4, maybe try 16. Please test different numbers and see for which number you get faster output. I understand when the batch size is too big, the tool might return an out of memory error. 

I hope this helps. 

Cheers!