topic arcgis.learn jupyter notebook, deep learning in ArcGIS API for Python Questions

arcgis.learn jupyter notebook, deep learning

MuhammadWaqar — Thu, 01 Jul 2021 12:47:35 GMT

Hello,

I am trying to train deep learning model through jupyter notebook. I have run the road cracks detection tutorial and it works fine but when I try to train on any other dataset it gives too much validation loss and sometimes it doesn't find correct learning rate. Kindly guide what I might be doing wrong or what parameters should be set like chip_size etc before starting training ssd.

Re: arcgis.learn jupyter notebook, deep learning

DrVSSKiran — Thu, 01 Jul 2021 13:00:18 GMT

Increase epochs sizes and training set to reduce the validation loss. Please do it and let me know.

Thanks

Re: arcgis.learn jupyter notebook, deep learning

MuhammadWaqar — Fri, 02 Jul 2021 04:31:41 GMT

Thanks for your response. I have tried on 35 epochs recently and on 20 epochs in the past. The issue is that the validation loss is low at the beginning but it increases drastically for some epochs. Sometimes it even goes to 50000+ for some epochs. I have attached a screenshot for you. Number of training samples is 4000.

Re: arcgis.learn jupyter notebook, deep learning

DrVSSKiran — Fri, 02 Jul 2021 20:10:41 GMT

Try to increase few more training samples and epochs size increases to 70 and reduce the patch size 25%.