topic Re: Model builder in ModelBuilder Questions

Model builder

PradeepAdhikari1 — Thu, 19 Apr 2018 14:11:56 GMT

Problem: Getting ERROR 999999 while executing function in ArcMap 10.6 model builder.

I want to sum six different variables to a raster and save in a file geodatabase. The six variables are contained in a netcdf (nc4) file. The netcdf files are from the GLDAS-NOAH 3hrly model output. I have about 15 thousand netcdf files (each about 7 MB) for the year 2010-2014 in a folder.

I am using model builder in ArcMap 10.6. The screen shot of the model is attached.

The problem is the model works for about 70-85 files then stops with an error message like the one below:

ERROR 999999: Error executing function.

The table was not found. [VAT_G20000513_1800]

No spatial reference exists.

Failed to execute (Cell Statistics).

[Here, G20000513_1800 is one of the netCDF files that I am processing]

Once I close all program and restart the process, the model runs again stops after processing 70-85 files with a similar error message.

I think the error is memory issue. I installed and tried use background geoprocessing (64 bit) for 10.6. I also saved the intermediate files in a separate folder but it did not help either. Is there a way to resolve this? I am working on Windows 7 Enterprise 64 bit PC with 16 GB RAM

Thanks

Re: Model builder

DanPatterson_Retired — Thu, 19 Apr 2018 14:26:29 GMT

do all the tools in your model support 64bit background geoprocessing?

http://desktop.arcgis.com/en/arcmap/latest/analyze/executing-tools/64bit-background.htm

You can check the General tab of the tool properties for the Always run in foreground check box to see if a tool is capable of running in the background.

Re: Model builder

PradeepAdhikari1 — Thu, 19 Apr 2018 14:45:46 GMT

Yes, they do.

Re: Model builder

PradeepAdhikari1 — Thu, 19 Apr 2018 15:42:44 GMT

Hi Dan, just a while ago, I re-ran my model in background just to be sure. This time as before, it processed 84 of my netCDF files and stopped with different error message as below:

ERROR 000539: Error running expression: rcexec()
Traceback (most recent call last):
File "<expression>", line 1, in <module>
File "<string>", line 8, in rcexec
RuntimeError: ERROR 999998: Unexpected Error.

The table was not found. [VAT_rastercalc1]
Failed to execute (Raster Calculator).

Re: Model builder

DanPatterson_Retired — Thu, 19 Apr 2018 18:08:30 GMT

bad netcdf perhaps... something didn't work, so shift your inputs and see if it stops at a different number (ie skip the first 10 in your list and see if it only processes 74... if it does, then that is the bad one).

Re: Model builder

PradeepAdhikari1 — Thu, 19 Apr 2018 18:35:02 GMT

Thank you Dan. I have tried option you suggested. I am pretty sure that the issue is not with netcdf data. Once the model stops with an error and I restart from the point where it stopped before, it runs again for about 70-85 files.

Re: Model builder

DanPatterson_Retired — Thu, 19 Apr 2018 18:49:29 GMT

sounds like resources then... Pro and a beefier machine if judicious in-model cleanup isn't possible... may be time to export the model to a script too, you might have better control over deleting/removing unneeded objects during the processing.

Re: Model builder

curtvprice — Thu, 03 May 2018 04:32:09 GMT

You should probably put preconditions on your Delete calls to make sure the Copy Raster happens before you delete the layer that reads it.