ArcGIS Pro Deep Learning v3.2 still not using multiple GPUs

Question

I'm using ArcGIS Pro and Deep Learning API v.3.2.  My machine has multiple NVIDIA GPUs:  4 RTX A4000 and 2 RTX A6000.  In addition, my machine also has the Microsoft Basic Display Adapter and Microsoft Remote Display Adapter, 28 cores, 1 TB of RAM and running Microsoft Windows 10 Enterprise.

According to here, if I use model parameter U-net, ArcGIS will use all available GPUs.  I selected GPU as my processor type and left GPU ID as blank, hoping it would use all available GPUs.

However, based on Task Manager display, the CPU is doing most of the work.

I also tried nvidia-smi to check the performance and it's also showing that the GPUs are practically not being used.

The following shows my parameter and environment settings:

What am I doing wrong?  Appreciate any help.

PavanYadav · Answer

@JadedEarth The Train Deep Learning tool of ArcGIS support multiple GPUs. for select model types. We are hoping to have all inferencing support it in 3.3 release. And, yes the API has more support training.

https://developers.arcgis.com/python/guide/utilize-multiple-gpus-to-train-model/

https://pro.arcgis.com/en/pro-app/latest/tool-reference/image-analyst/train-deep-learning-model.htm

JadedEarth · Answer

Now, I'm told multi-gpu support only works from command line.  Does anyone know where the instructions are located for command line deep learning instructions for multi-gpu?

JadedEarth · Answer

The computer we're using is NOT a desktop computer since we needed to install multiple GPUs.  Here's the computer photo below.  We also added multiple GPUs on this computer.