topic Re: ArcHydro Problem Solvers in Water Resources Questions

ArcHydro Problem Solvers

MarkBoucher — Thu, 19 Jan 2012 14:10:44 GMT

This is a collection of actions I've learned to take when I'm having problems with ArcHydro or HEC-GeoHMS. I'll add to the list when I find more.

Make sure the Geoprocessing extents include the whole project: Go to the Geoprocessing menu>Environments...>Processing Extent. Under Processing Extent choose a layer that you know covers the full extent of the waters you are processing and click OK. This should ensure that the processing extent is large enough to do what you want.

Delete everything you can in your temp folder: Mine is C:\Users\mboucher\AppData\Local\Temp. Get out of ArcMap first to clear temp files related to your project. You can do this without getting out of ArcMap through the ArcHydro Toolbar under ApUtilities>Additional Utilities>Clean User's Temp Folder.

Make sure your Target Locations are correct: Under ApUtilities>Set Target Locations, make sure the HydroConfig and they GeoHMSConfig Targets make sense. The raster data should go to the project folder vector data to a geodatabase. The raster data will go to a folder in the project folder with the dataframe name and the vector data to a feature data set with the dataframe name. Through the ArcHydro Toolbar under there is a function to reset the target locations: ApUtilities>Additional Utilities>Reset Target Locations. I've not tested this to see if it corrects everything.

When working on a complicated model, don't use the model mxd for your presentation map. It just adds baggage to an already "heavy" mxd.

If you have additional actions or clarifications on these, please chime in.

Re: ArcHydro Problem Solvers

TimothyMaguire — Thu, 19 Jan 2012 20:45:57 GMT

Thanks Mark. Very helpful.
Tim

Re: ArcHydro Problem Solvers

MarkBoucher — Sat, 11 Dec 2021 21:55:38 GMT

As an addition to the earlier tips. I just found that when I put the mxd in a folder with a simple name and no spaces, the Terrain Processing with Arc Hydro ran without a hitch.

Today I happened to look in the "log" file in the raster folder for the project and saw that a raster name was cut off. In the example below you can see that the flow accumluation file name was cut off after the "f".

201201251045   0     1     0mboucher P:\GIS USERS - Projects\Arc Hydro\Research\Project2\Fdr = FLOWDIRECTION(P:\GIS USERS - Projects\Arc Hydro\Research\Project2\Fil
201201251050   0     1     0mboucher P:\GIS USERS - Projects\Arc Hydro\Research\Project2\Fac = FLOWACCUMULATION(P:\GIS USERS - Projects\Arc Hydro\Research\Project2\f

Putting the project in a simpler folder name with no spaces resluting int the "log" file looking like this:

201201251407   0     0     0mboucher P:\ArcHydro\Test\Project4\Fdr = FLOWDIRECTION(P:\ArcHydro\Test\Project4\Fil,  #, NORMAL)201201251407   0     1     0mboucher P:\ArcHydro\Test\Project4\Fac = FLOWACCUMULATION(P:\ArcHydro\Test\Project4\Fdr,  #, FLOAT)
201201251407   0     0     0mboucher P:\ArcHydro\Test\Project4\str = CON(C:\Users\mboucher\AppData\Local\Temp\AH20120125140707\condgeo, C:\Users\mboucher\AppData\Local\Temp\AH20120125140707\condgeo)
201201251407   0     1     0mboucher P:\ArcHydro\Test\Project4\StrLnk = STREAMLINK(P:\ArcHydro\Test\Project4\str, P:\ArcHydro\Test\Project4\Fdr)

You can see that their is much more to the file name and some other info. I don't know if there is a limit to the length of the path or if some functions don't like the spaces in the path. Eitherway, I'm going to keep things short and spaceless for a while and see if that works. I've been aware of naming problems when there were spaces, but that hasn't seemed to cause a problem before. I've always muscled through it.

With this change in practice, I used the canned terrain processing model with no problems.

Re: ArcHydro Problem Solvers

MarkBoucher — Wed, 25 Jan 2012 22:46:38 GMT

One more thing... I've gathered from other posts that when using GeoHMS, things work better if you turn off background processing. Go to Geoprocessing>Geoprocessing Options... and uncheck "Enable" under "Background Processing".

Re: ArcHydro Problem Solvers

MarkBoucher — Fri, 27 Jan 2012 18:47:35 GMT

Just to consolidate, Stacie Wolny submitted another one today: http://forums.arcgis.com/threads/48666-ArcHydro-doesn-t-output-to-shapefile

Re: ArcHydro Problem Solvers

MarkBoucher — Mon, 09 Jul 2012 16:37:25 GMT

Raster Extent Problem addressed: http://forums.arcgis.com/threads/41988-Resetting-Raster-calculation-limits

Re: ArcHydro Problem Solvers

neilo_brien — Thu, 26 Jul 2012 16:31:26 GMT

Errors when running tools from HEC-GeoHMS toolbar.

Workaround:
Do not enable the Background Processing option on the Geoprocessing Options editor.

1. Go to Geoprocessing, Geoprocessing Options�?�
2. Make sure the Enable checkbox is not checked under Background Processing.

If background processing was checked then start the GeoHMS project over.

Re: ArcHydro Problem Solvers

MarkBoucher — Thu, 02 Aug 2012 15:51:39 GMT

A couple more links related to the Arc Hydro Process:

http://forums.arcgis.com/threads/53316-Why-can-t-I-define-a-stream-network?p=182644#post182644

http://forums.arcgis.com/threads/52110-Terrain-Processing-Steps.?p=178067#poststop

Re: ArcHydro Problem Solvers

MarkBoucher — Wed, 08 Aug 2012 13:35:14 GMT

Very good document every Arc Hydro user should have:
http://downloads.esri.com/support/datamodels/Hydro/Comprehensive_terrain_preprocessing_using_Arc_Hydro_tools_2008.zip

I found it here:
http://support.esri.com/en/downloads/datamodel/detail/15.

Re: ArcHydro Problem Solvers

MarkBoucher — Fri, 19 Oct 2012 17:15:10 GMT

I've started a practice that seems to make many errors/crashes go away.

Layers/rasters needed for Arc Hydro are:

DEM PROCESSING:

rawdem (Extracted by mask from county-wide dem for each project. Set processing extents using this or mask ploly)

agreestream*

innerwalls*

outerwalls*

*I do work all over my County and so have county-wide "master" geodatabase for these that I use on all my Arc Hydro Projects.

WATERSHED DELINEATION:

BatchPoints

If I have these layers, I can recreate the hydrologically correct DEM (HC DEM) anytime I want and re-delineate the watersheds.

So my practice is this: As I'm developing my HC DEM, and have to modify the agreedem, innerwalls, outerwalls layers, I can save the BatchPoints to my project folder and then delete the geodatabase and folder with rasters in it (Target Locations). This starts everything fresh and new. Then I can use model builder to reprocess the watersheds. When I'm ready to re-delineate the watersheds, I copy the BatchPoints into the geodatabase and set the BatchDone value to "0".

I run the watershed delineation, etc. via the Arc Hydro menus though I could possibly do this via Model Builder also. Since I've started doing this (and following solutions in the postings above on this thread), my crashes and errors have all gone away! Here is the ModelBuilder model for my latest project. I don't use outerwalls on this project, but that could be added.

[ATTACH=CONFIG]18585[/ATTACH]

Re: ArcHydro Problem Solvers

MarkBoucher — Wed, 24 Oct 2012 13:48:01 GMT

A good summary by dahri of things to do to reduce crashes:

http://forums.arcgis.com/threads/40476-Windows-Professional-64-bit-and-ArcHydro-Bugs-encountered?p=216050#poststop

Re: Error in DEM Reconditionung in Arc Hydro 10.1

YuryKorobochkin — Thu, 25 Oct 2012 15:58:12 GMT

Dear Mark,
my thanks for reply.
The matter is that befor I applyed the Forum I have read information there and deleleted all files from directory by using "Clean Usre's Temp Folder". But these actions didn't help. I simply don't know what to do.
Now I again clean this folder , but have got the same negative result.
Please, advise me what I have to do more.
Besty regards
Yury

Re: ArcHydro Problem Solvers

MarkBoucher — Mon, 05 Nov 2012 16:24:14 GMT

An important note from ESRI about OID vs OBJECTID:
http://forums.arcgis.com/threads/68360-Error-in-DEM-Reconditioning-in-Arc-hydro-10?p=245919#poststop

Re: ArcHydro Problem Solvers

MarkBoucher — Tue, 29 Jan 2013 21:46:21 GMT

Putting the data on your local drive instead of on the network will not only speed up the terrain processing, several functions that usually fail will magically work.

Re: ArcHydro Problem Solvers

MarkBoucher — Wed, 30 Jan 2013 17:55:33 GMT

Clarification on the process:
http://forums.arcgis.com/threads/76491-unable-to-recondition-or-burn-stream-into-raster?p=268404#post268404

Re: ArcHydro Problem Solvers

MarkBoucher — Tue, 05 Feb 2013 13:55:19 GMT

This is a very good overview of the Arc Hydro process though it is about the Spatial Analyst Hydrology toolset.
http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#/Understanding_drainage_systems/009z0000005m000000/

However, I have to disagree with the flow chart in this link (part of the same series). I would always perform a fill before running the flow direction. There is something wrong with the flow chart. It should show the process going from the dimensionless DEM box to a flow direction step then to the flow accumulation. Sorry, I'm being a little picky here, but someone new to this could get frustrated by the flowchart. The steps I use are posted and/or linked elsewhere in this thread (see post #2 in the post right before this one).
http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#/Deriving_runoff_characteristics/009z0000005p000000/.

The third paragraph in this link (part of the same series) points out that most DEMs have sinks. Mine always do, hence, why I always would run a fill sink process before I run the flow direction.
http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#/How_Fill_works/009z00000061000000/

Re: ArcHydro Problem Solvers

JordanAdams2 — Tue, 05 Feb 2013 17:42:13 GMT

Hi, I found this thread after finding a similar error here: http://forums.arcgis.com/threads/48081-ArcHydro-Error?highlight=flow+direction

I've been teaching myself Arc Hydro Tools using this walkthrough from Purdue University, using the data provided in the zip file: http://web.ics.purdue.edu/~vmerwade/education/terrain_processing.pdf

Even after making the adjustments recommended in this thread, I would say 50% of the time I get an error message similar to the one seen in the top link. The other half of the time, I get a Flow Direction raster that has no attributes. Any ideas what the heck is going on or how to rectify this situation?

Thanks!

Re: ArcHydro Problem Solvers

MarkBoucher — Tue, 05 Feb 2013 19:26:53 GMT

I've been meaning to make a list of things to do before starting an Arc Hydro project. JAdams15's question pushed me to do it. This is more to remind myself and staff here that might venture into watershed processing than anything else. I hate making the same mistakes twice. Many of these ideas you'll find earlier in this thread.

Getting a project started:

For fastest processing, put the project directory on your local computer (C: drive). Processing over a network kills your speed.

Keep the layer, file, and directory names short and with no spaces or non-alpha numeric characters. Use "_" if you must. I don't use "-". I suspect it causes problems.

Make sure the HydroConfig Target Locations are correct. If you start the project and then move it to another folder, the Target Locations will not change on their own. The GeoHMSConfig Target Locations should be checked if using GeoHMS. Use the ApUtilities > Additional Utilities>Reset Target Locations menu command to reset them. I always check them under ApUtilities>Set Target Locations.

Make sure the Spatial Analyst extension is selected under Customize>Extensions.

Make sure your Geoprocessing Extents match the area you want to process. Use Geoprocessing>Environments>Processing Extent menu command. I make it match the DEM or the mask I used to extract the DEM for the project. In doing batch point delineation I've had this change to the batch point extent and produce puzzling results.

Disable Background Processing via Geoprocessing>Options menu.

Set the "Max number of unique values to render" to a high number (I use 30,000,000: Don't ask me why.) Adjust this setting under Customize>ArcMap Options>Raster tab>Raster Dataset tab.

Putting the agreestream, innerwall and outerwall layers in a geodatabase is a good idea.

After you've been working on the project a while:

If you are starting over on the process after getting much of the way through it, close Arc Map and via Windows Explorer delete the folders (would have the same name as your data frame) and the geodatabase (would have the same name as your mxd). This makes sure there are not locks on layers/rasters and no denials for overwriting files. The only layer I copy out of this is the Batch Point layer. I make a copy in the main directory so I don't have to create them again.

Clear out the temp file directory. Do this as often as you think of it. There's a tool under ApUtilities that does this nicely.

At times, a reboot of the PC does wonders. I'm not sure why this helps other than it might eliminate software conflicts if you are using more than one program.

Please, please contribute if you see I'm missing something.

Word Version Attached:

Re: ArcHydro Problem Solvers

MarkBoucher — Wed, 06 Feb 2013 17:21:37 GMT

ESRI Arc Hydro ftp site information:
http://forums.arcgis.com/threads/71180-Error-when-DEM-reconditioning?p=255178&viewfull=1#post255178

Re: ArcHydro Problem Solvers

MarkBoucher — Thu, 07 Mar 2013 17:17:52 GMT

Arc Hydro tutorials for moved: http://forums.arcgis.com/threads/79329-ArcHydro-Tutorial-and-Documentation