ERROR 010658: Failure in distributed raster analytics operation.

[cmlosaria_gis]

Hi, I am trying to run the "cost distance tool" against my cost raster and am facing this error. Here is a log

Cost Distance
=====================
Parameters

Input raster or feature source data najran_origin_PointToRaster
Input cost raster weighted_cost_rasterV2
Output distance raster D:\Personal\Project\Folder\Analysis\Default.gdb\cost_distance_najran
Maximum distance
Output backlink raster
Multiplier to apply to costs
Start cost
Accumulative cost resistance rate
Capacity
Travel direction
=====================
Messages

Start Time: Wednesday, October 5, 2022 1:00:23 AM
Temporary data will be created in C:\Users\ADMIN\AppData\Local\Temp\ArcGISProTemp2068\s48c8f4b1_25bc_48cf_a45e_d66ece8b296f
WARNING 010648: 202,886 MB of temporary storage is estimated to be needed. 111,350 MB of storage is currently available.
Distributing operation across 10 parallel instances.
2022-10-05T01:01:19.247: Initialization Phase ...
2022-10-05T01:08:23.626: Iteration Phase ...
ERROR 010658: Failure in distributed raster analytics operation.
Canceled function
Canceled function
Failed to execute (CostDistance).
Failed at Wednesday, October 5, 2022 2:28:48 AM (Elapsed Time: 1 hours 28 minutes 25 seconds)

Sometimes this tool works against the same raster data, but more often than not it doesn't work!

Here's what I tried

1. I tried to use the Distance accumulation tool (it said better performance but faced the same warning)
2. Cleared my TEMP folder (I have over 19GB of storage free but get this low storage warning)
3. Changed TEMP and TMP folder in Windows system environments variables

I checked and checked there is no documentation of this error. What could be the problem?

[cnnlly]

The issue for me appeared to be a difference in Python/ArcPy versions between Enterprise 10.9.1 and ArcGIS Pro 2.9.4. The resolution was to roll back ArcGIS Pro to core version 2.8 and publish to Enterprise 10.9.1 from it instead.

[CarlosRibeiro]

Hi, folks.

I'm quite sure this error is related to using parallel processing. Setting the Parallel Processing Factor to 0% (yeap! zero) runs without error!

OS: Windows 10 Build 19045
Dell Precision M6700 - 32GB RAM - i7-3940XM - 2 SSD hard drives
ArcGIS Pro 3.02

Cheers,
Carlos Ribeiro

[KingsleyFasesin]

Fixed: I recently encountered the same problem, but the problem was the failure to clip the raster to boundary extent before carrying out raster analytics on it. Clip your raster first to the boundary extent and then use the new clipped_raster

[JohnHughson · Accepted solution]

Hello to all that are Interested,

I work with Esri Australia technical support and just wanted to provide a workaround that we found whilst working on this issue. 

In this instance the issue was related to the format of the raster:

TIFF with unsigned integers, 32-bit. The range of values for this raster started with zero. 

We found two workarounds:

• Convert to signed integers by exporting to a new raster dataset. 
• Use the raster calculator to add 1 to the cells, run the Fill Sinks tool, then use raster calculator again to subtractor 1 from the output.

John

[JosephMcGehan · Accepted solution]

Thanks, John. 

This solution worked for us. 

[MdOmerHossain]

Hi, 

I was trying to run Euclidean distance from a vector layer. I am also facing the same problem and couldn't figure it out how to solve it. How to solve this problem for vector data?

[ElizabethGraham]

Hi,

I'd like to help you figure out what is the problem. 

What messages is the tool displaying, can you please share a screenshot? 

Thanks,

Liz Graham

Product Engineer on the Spatial Analyst Extension

[MdOmerHossain]

I am trying to run Euclidean distance of al the water bodies (NHDFlowline+NHDArea+NHDwaterbody from FDEP as well as SSURGO water body) in NEEPP area. I want my cell size same as my DEM (2.5ft or 0.762m). When I run, I see this error message.

I am using ArcGIS Pro 3.3.1. 

My computer has 2 SSD drives, on is 500GB the other one is 4 TB. I have 120GB of RAM. 

Euclidean Distance
=====================
Parameters

Input raster or feature source data LARNLoad_water_NEEPP
Output distance raster E:\ERG\Diatnce_NEEPP\Distance_water_NEEPP\Distance_water_NEEPP.gdb\Distance2wt_NEEPP
Maximum distance
Output cell size E:\ERG\Diatnce_NEEPP\Distance_water_NEEPP\Distance_water_NEEPP.gdb\DEM_NEEPP_signed
Output direction raster
Distance Method PLANAR
Input raster or feature barrier data
Out back direction raster
=====================
Environments

Output Coordinate System PROJCS["NAD_1983_2011_Florida_GDL_Albers",GEOGCS["GCS_NAD_1983_2011",DATUM["D_NAD_1983_2011",SPHEROID["GRS_1980",6378137.0,298.257222101]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]],PROJECTION["Albers"],PARAMETER["False_Easting",400000.0],PARAMETER["False_Northing",0.0],PARAMETER["Central_Meridian",-84.0],PARAMETER["Standard_Parallel_1",24.0],PARAMETER["Standard_Parallel_2",31.5],PARAMETER["Latitude_Of_Origin",24.0],UNIT["Meter",1.0]]
Extent 591483.4782 257975.9759 781491.133699998 511006.1561 PROJCS["NAD_1983_2011_Florida_GDL_Albers",GEOGCS["GCS_NAD_1983_2011",DATUM["D_NAD_1983_2011",SPHEROID["GRS_1980",6378137.0,298.257222101]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]],PROJECTION["Albers"],PARAMETER["False_Easting",400000.0],PARAMETER["False_Northing",0.0],PARAMETER["Central_Meridian",-84.0],PARAMETER["Standard_Parallel_1",24.0],PARAMETER["Standard_Parallel_2",31.5],PARAMETER["Latitude_Of_Origin",24.0],UNIT["Meter",1.0]]
Cell Size DEM_NEEPP_signed
Mask NorthernEvergladesBuffer_1km
=====================
Messages

Start Time: Sunday, November 17, 2024 2:20:32 PM
Temporary data will be created in C:\Users\MHOSSA~1\AppData\Local\Temp\ArcGISProTemp20200\s8b69401d_eac5_434d_bc56_b3379bf09927
WARNING 010648: 637,214 MB of temporary storage is estimated to be needed. 306,222 MB of storage is currently available.
Distributing operation across 16 parallel instances.
2024-11-17T14:21:00.232: Initialization Phase ...
ERROR 010658: Failure in raster analytics operation.
Canceled function
Failed to execute (EucDistance).
Failed at Sunday, November 17, 2024 3:10:46 PM (Elapsed Time: 50 minutes 13 seconds)

[ElizabethGraham]

Hi,

Thank you for all of the additional information!

It looks like the temp data location is on the C drive (C:\Users\MHOSSA~1\AppData\Local\Temp\. . . ), which has 306,222 MB of storage available.  However, the tool needs 637,214 MB of temporary storage.

• WARNING 010648: 637,214 MB of temporary storage is estimated to be needed. 306,222 MB of storage is currently available. 

Try setting your TempFolder to a location on the drive that has 4 TB (if there is 637,214 MB of available storage there.) 

To set the temp storage: 

When using parallel processing, temporary data will be written to manage the data chunks being processed. The default temp folder location will be on your local C: drive. You can control the location of this folder by setting up a system environment variable named TempFolders and specifying the path to a folder to use (for example, E:\RasterCache). 

Let me know if this works.

Thanks,
Liz

[MdOmerHossain]

Hi Liz Graham,

Thank you for your suggestion. I was trying to set the path for temfolder in my E drive by following the instruction you provided. But for some reason I didn't change. Then I took help from our university IT team and they change the path from the environment setting of Arc Gis pro not from the window system environment. By doing so, I didn't the face the previous storage warning and it's storing temporary data in E drive. However, the fact is that it has been already 1 day the tool has been running, and I still have not get any result either successful or failed. What is the reason? Is it working?  

Here is my current status. 

Euclidean Distance
=====================
Tool Path

Input raster or feature source data LARNLoad_water_NEEPP
Output distance raster E:\ERG\Diatnce_NEEPP\Distance_water_NEEPP\Distance_to_water_NEEPP.gdb\Distance_to_water_NEEPP
Maximum distance
Output cell size E:\ERG\Diatnce_NEEPP\Distance_water_NEEPP\Distance_water_NEEPP.gdb\DEM_NEEPP_clipped
Output direction raster
Distance Method PLANAR
Input raster or feature barrier data
Out back direction raster
=====================
Environments

Output Coordinate System PROJCS["NAD_1983_2011_Florida_GDL_Albers",GEOGCS["GCS_NAD_1983_2011",DATUM["D_NAD_1983_2011",SPHEROID["GRS_1980",6378137.0,298.257222101]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]],PROJECTION["Albers"],PARAMETER["False_Easting",400000.0],PARAMETER["False_Northing",0.0],PARAMETER["Central_Meridian",-84.0],PARAMETER["Standard_Parallel_1",24.0],PARAMETER["Standard_Parallel_2",31.5],PARAMETER["Latitude_Of_Origin",24.0],UNIT["Meter",1.0]]
Extent 591483.4782 257975.9759 781491.133699998 511006.1561 PROJCS["NAD_1983_2011_Florida_GDL_Albers",GEOGCS["GCS_NAD_1983_2011",DATUM["D_NAD_1983_2011",SPHEROID["GRS_1980",6378137.0,298.257222101]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]],PROJECTION["Albers"],PARAMETER["False_Easting",400000.0],PARAMETER["False_Northing",0.0],PARAMETER["Central_Meridian",-84.0],PARAMETER["Standard_Parallel_1",24.0],PARAMETER["Standard_Parallel_2",31.5],PARAMETER["Latitude_Of_Origin",24.0],UNIT["Meter",1.0]]
Cell Size DEM_NEEPP_clipped
Mask NorthernEvergladesBuffer_1km
=====================
Messages

Start Time: Wednesday, November 20, 2024 2:54:34 PM
Temporary data will be created in E:\Software\RasterCache\ArcGISProTemp25828\s0c328dcd_7afd_4852_b23a_3b8b58360183
637,214 MB of temporary storage is estimated to be needed. 2,244,874 MB of storage is currently available.
Distributing operation across 16 parallel instances.
2024-11-20T14:55:18.015: Initialization Phase ...

Moreover, despite having more than enough storage, my computer has been slowed down as the Euclidean distance still running.