topic running the batch on a model isn't working in Geoprocessing Questions

running the batch on a model isn't working

KieranGibson — Thu, 18 Oct 2012 13:03:37 GMT

I have a model that I created and it does not contain any iterators. When I try and run a batch the model only runs for the first row or processes in the batch table. This has happened to me before. Is there something that I can do to make sure that all the processes are run?

Re: running the batch on a model isn't working

T__WayneWhitley — Thu, 18 Oct 2012 14:13:49 GMT

Did you already solve your problem? If not, if you would please attach your model/script or whatever samples for troubleshooting and testing purposes, that would help forum members help you, and you will definitely increase your chances of getting a response.
Otherwise, keep plugging away! 🙂

Re: running the batch on a model isn't working

KieranGibson — Thu, 18 Oct 2012 14:50:11 GMT

Thank you very much for the suggestion Wayne. My model is attached and is working. I am using inline variable substitution in my model to create raster catalogs and load the catalogs from a workspace. My hope was to use the batch to process. When I try a batch it only runs the first line on the batch file. There is no error message, it just doesn't continue on to the next process. Thank you so much for your help!

Re: running the batch on a model isn't working

T__WayneWhitley — Thu, 18 Oct 2012 15:06:14 GMT

OK, glad it's running. So for future use you'd still like to be able to run in batch mode?
I can take a better look after lunch if that is the case. Can you zip and attach the actual model, etc.? - I'm still working w/ 10 Desktop.

Re: running the batch on a model isn't working

KieranGibson — Thu, 18 Oct 2012 15:43:42 GMT

Wayne, I attached a zip with the toolblx and a copy of my model. I would like to use this in batch mode but it only runs the first process only. Thank you so much for your help and looking over this.:)

Re: running the batch on a model isn't working

T__WayneWhitley — Thu, 18 Oct 2012 18:02:12 GMT

OK, I've got around to opening this - curious, first of all, are you are using 'Workspace to Raster Catalog' properly?
It appears you want to override the tool's capability to 'walk' your subdirectory structure and selectively load individual raster catalogs by county?...and you have individual county mdbs already set up?

The 'Workspace to Raster Catalog' tool simply 'loads' raster datasets into a single catalog....apparently it will even 'walk' the directory loading what it finds in subfolders, a nice tool feature. Is this what you want to do? Clarify please.

Re: running the batch on a model isn't working

KieranGibson — Thu, 18 Oct 2012 18:14:35 GMT

Yes, I am using the 'Workspace to Raster Catalog' tool. I have individual county mdbs already set up, and want to create raster catalogs to and load them with images. I have the tool working so that I put in the parameters and it fills in the necessary paths and names. The tool will run fine for one county, when I try to batch process it by right clicking on the model name it only runs for the first county and disregards the other counties I have added to the batch. I am wanting to simply 'load' raster datasets into a single catalog and have that catalog go into the county mdb., but do it multiple times using different county names and different mdbs. Thank you again for all of your help!:)

Re: running the batch on a model isn't working

T__WayneWhitley — Thu, 18 Oct 2012 18:52:11 GMT

I would actually prefer accomplishing this via Python if for nothing more than the ability to better trap errors; however, I don't think it's fair to impose my preferences onto you, so bear with me and l'll try to troubleshoot this with you.

So let's try or check the following:
- you have verified the test data is already set up to run, inputs and outputs and nothing is locked, correct?
- you have results on the 1st round of execution, correct (Franklin County in your example)?

Be aware there is also a 'Copy Raster Catalog Items' tool - so why not try breaking up the problem by 1st using 'Workspace to Raster Catalog' and see what results you can produce in loading a single catalog, doesn't matter what you name it (or even what you load it with at this point).

Also, are you able to retrieve any error messages so far?

Re: running the batch on a model isn't working

KieranGibson — Thu, 18 Oct 2012 19:19:15 GMT

Hey Wayne,

I have verified that the test data is ready, and I have results on the 1st round of execution. I am trying first by using "Workspace to Raster' and it has completed with no error messages. The raster catalog was created and put in the correct database and then loaded with all of the images.

Re: running the batch on a model isn't working

T__WayneWhitley — Thu, 18 Oct 2012 19:52:15 GMT

Alright then, I have run a successful batch test of a simple model I set up similar to yours - did you say your model would not complete the 2nd iteration? I ask because I set up mine to run twice and indeed it did successfully run with no error messages. I had the 2nd run to write to a separate output catalog in a separate mdb, and I did get the appropriate output after I refreshed my view.

I didn't apply any 'inline variable substitution' at this point. As a result, both of my output catalogs are hard-coded named 'test' --- which is fine for troubleshooting, just want to verify the geoprocessing to this point is sound.

May not be necessary for you, but I set mine up to 'walk' the subdirectory from the root I specify on each input line in the batch mode. I'm inserting a pic of what I have so far for starters... (note - Only the params shown in blue showed up in the form in batch mode.)

[ATTACH=CONFIG]18557[/ATTACH]

Re: running the batch on a model isn't working

KieranGibson — Thu, 18 Oct 2012 20:07:38 GMT

Dear Wayne,

Yes that is correct, my model will not run the 2nd iteration, do you think it is due to the inline variable substituion? I also have the second process writing to a serperate catalog in a seperate mdb.

I am confused at the term 'walk' you are using, is that something I should be using?

Also You said that you set your batch to run twice, does that mean you just put two counties into the batch window like the image I attached?

Re: running the batch on a model isn't working

T__WayneWhitley — Thu, 18 Oct 2012 20:22:54 GMT

Yes to your last question - 2 iterations = 2 runs as you illustrated.
When I say 'walk', I simply mean the tool can 'drill down' from the root location to load from subdirectories -- probably you're already aware of this option and all this means is if you have a root for a county already set up for input raster datasets, but they're grouped into subfolders by sections of some sort, the 'from workspace' tool has a box to check on (include Sub-directories), and simply goes through each contained subfolder from the root to 'collect' the datasets and load them all. Very convenient.

I discovered why I have 2 params showing up in batch mode instead of the 3 I was aiming for - the param I attempted to set is 'derived' -- I'll attach another pic to show you what I should have done. And from this point, if at least the batch mode is proven adequate (I think so), then I guess you'll want to work on the 'inline text sub'. Not sure if this'll work in ModelBuilder in the way you intend, but there's always a workaround!

[ATTACH=CONFIG]18560[/ATTACH]

Re: running the batch on a model isn't working

T__WayneWhitley — Thu, 18 Oct 2012 20:31:01 GMT

I'm sending you the test toolbox to try, produced in 10.
Try it in batch mode to see if at least this is on the right track before fiddling around with inline text... OK?

Forgot to check off the managed mode on type - see the Create Raster Catalog tool inside the model, and for testing purposes change this to 'unmanaged' so at least you'll have a quicker run! 🙂

Re: running the batch on a model isn't working

KieranGibson — Thu, 18 Oct 2012 20:36:40 GMT

Wayne,
Thank you so much for all of your help and time you have been putting into this. I am going to continue to look at this and may have to try something other than inline variable substitution. In the mean time it is 5:30 here and I have somewhere I have to be. Again I really appreciate your help, I will be able to access this work again on Monday and will post something to the thread if I figure anything out or have any more questions. I am looking forward to trying the test toolbox you have sent and hope I can get it to work on Monday. Again, I hate to run off like this and really appreciate your help. Have a wonderful weekend!

Sincerely,
Kieran Gibson:D

Re: running the batch on a model isn't working

T__WayneWhitley — Thu, 18 Oct 2012 22:16:46 GMT

Ahh, no worries.

And just to report back before I too must leave, it's highly likely you will have to use some 'model only' tools to get your inline var sub to work, like 'parse path' (I think it is called) .... anyway, for me this is easier via Python, and in fact it appears on 1st glance at the documentation you'll be using Python snippets to get the job done. So I'm interested now to see how ModelBuilder accommodates in order to get the job done.

These tools can be accessed (at 10 and 10.1) within the ModelBuilder window, using right-click. Good docs here and I'll test/post back here later - calculate value looks to be a powerful tool to use, esp if proficient at building functions:
http://resources.arcgis.com/en/help/main/10.1/index.html#/Parse_Path/004000000008000000/
http://resources.arcgis.com/en/help/main/10.1/index.html#/Calculate_Value/004000000004000000/

Re: running the batch on a model isn't working

KieranGibson — Mon, 22 Oct 2012 16:19:55 GMT

Good Afternoon Wayne,

I was able to get the batch working without using the inline var sub. I will continue to look at the links you posted and solve it using the model only tools or maybe even some python. I hope you have a wonderful day and thank you for your help.