topic Re: Deep Learning Studio 11.1 (Linux) in Deep Learning Studio Questions

Deep Learning Studio 11.1 (Linux)

S6 — Wed, 11 Oct 2023 09:51:25 GMT

Hi,

We have installed Image Server 11.1 & Raster Analytics in a NVIDIA DGX machine with 4 GPU cards.

How can we leverage all 4 GPUs while training the model in Deep Learning Studio?

Thanks & regards,

Saranya

Re: Deep Learning Studio 11.1 (Linux)

JayChen — Wed, 11 Oct 2023 18:30:06 GMT

Hi Saranya,

At 11.1, when it gets to train model using a RA site in an enterprise environment, each image server node within the Raster Analytics site can still use one and only one GPU. Deep Learning Studio will also carry this limitation since it's leveraging the RA site for processing. We are looking to remove this limitation in the future release.

-Jay

Re: Deep Learning Studio 11.1 (Linux)

S6 — Thu, 12 Oct 2023 03:16:02 GMT

Hi Jay,
Thank you for your prompt response.
Really appreciate it. Do you have a timeline on when this capability will be incorporated?

Re: Deep Learning Studio 11.1 (Linux)

JayChen — Thu, 12 Oct 2023 16:34:55 GMT

Hi Saranya,

We are working with Python API team on this, starting with supporting multiple GPUs on a single image server node for some of the model types. Unfortunately we don't yet have a clear timeline when this will be available for most of the model types. We do undertsdand that this is essential for some of the customers, especially when it goes to the model training. Once it becomes available, the Deep Learning Studio will natually support it too. Thank you for your patience.

-Jay

Re: Deep Learning Studio 11.1 (Linux)

S6 — Thu, 12 Oct 2023 17:36:23 GMT

Thanks for the update Jay!

Re: Deep Learning Studio 11.1 (Linux)

S6 — Thu, 26 Oct 2023 02:47:06 GMT

Hi,

I have a follow up question.

https://enterprise.arcgis.com/en/image/latest/raster-analytics/configure-and-deploy-arcgis-enterprise-for-deep-learning-raster-analytics.htm

In this page, it says if I have multiple GPUs, I can run multiple instances. Does this mean if I have 16GPUs, I can run inferences on 16 images in parallel? One image per GPU?

Re: Deep Learning Studio 11.1 (Linux)

JayChen — Fri, 27 Oct 2023 16:40:23 GMT

Supporting multiple GPUs on your raster analytics node within your raster analytics site is not fully supported for all models yet. `Utilization of multiple GPUs per server node is applicable to some deep learning model configurations predefined in ArcGIS. They include Tensorflow (ObjectDetectionAPI and DeepLab), Keras (MaskRCNN), and PyTorch.`

For supported models, yes the job can be distributed to multiple GPUs on your RA node if there are multiple GPUs available and the Max instances per machine for RA services are set to be more than 1.

Re: Deep Learning Studio 11.1 (Linux)

S6 — Mon, 30 Oct 2023 04:33:02 GMT

Hi JayChen,

Thanks for your reply. Does the same apply for inferencing as well?

Re: Deep Learning Studio 11.1 (Linux)

JayChen — Tue, 31 Oct 2023 23:04:38 GMT

Yes. This should be on inferencing side.