Export training data for deep learning

802
12
11-05-2019 03:00 AM
Highlighted
New Contributor II

Hi all!

I'm trying to learn about python and deep learning. I have tried to follow the sample notebooks and watch the training courses but now i'm stucked.

I have done some training samples in Arcgis Pro with the training samples manager and saved it as a shapefile.

Then i export the samples with GP-tool "Export Training Data For Deep Learning" with KITTI Labels as Meta Data Format.

In jupyter notebook i write this to load the samples

from arcgis.learn import prepare_data
data = prepare_data('Path to my samples')
data.show_batch

The error i get

~\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone4\lib\site-packages\arcgis\learn\_data.py in prepare_data(path, class_mapping, chip_size, val_split_pct, batch_size, transforms, collate_fn, seed, dataset_type, resize_to, **kwargs)

572 return ner_prepare_data(dataset_type=dataset_type, path=path, class_mapping=class_mapping, val_split_pct=val_split_pct)

573 else:

--> 574 raise NotImplementedError('Unknown dataset_type="{}".'.format(dataset_type))

575

576 if dataset_type == 'RCNN_Masks':

NotImplementedError: Unknown dataset_type="KITTI_rectangles".

What am i doing wrong?

Regards Mattias

Reply
0 Kudos
12 Replies
Highlighted
MVP Esteemed Contributor

The error suggests that the details are to the path name you used.  If it was a shapefile did you add the *.shp file extension?  In any event more information on the file type and path name are needed

Reply
0 Kudos
Highlighted
New Contributor II

Here's the export tool and to the right is the folders with images that was created. 

data = prepare_data('Output Folder/chips') so how should prepare_data look like?

Reply
0 Kudos
Highlighted
New Contributor II
Reply
0 Kudos
Highlighted
MVP Esteemed Contributor

you might want to try it through the python interface.  The warning beside the output folder name suggests something is amiss

Export Training Data For Deep Learning—Help | ArcGIS Desktop 

Reply
0 Kudos
Highlighted
New Contributor II

I exported the training data via python interface but i got the same error when preparing data

Reply
0 Kudos
Highlighted
Esri Contributor

Mattias Tivlin‌ what kind of deep learning task do you want to do ? If it is an object detection task, you can try exporting data in the format 'pascal voc objects'.

Reply
0 Kudos
Highlighted
New Contributor III

Hi Mattias

  • Try to use metadata mode PASCAL VOC rectangles instead of KITTY rectangles.
  • Use PNG Format.
  • Replace all commas to points for each file in labels folder.

That worked for me.

Javier Escudero

Highlighted
New Contributor II

Great! I will try that

Reply
0 Kudos
Highlighted
New Contributor II

Its working now

Changed the comma to Points. Thank you so much for the help

Reply
0 Kudos