topic Re: arcpy.sa save random ERROR 999998: Unexpected Error in Python Questions

arcpy.sa save random ERROR 999998: Unexpected Error

IanMCDONALD — Fri, 10 Dec 2021 22:22:14 GMT

I am working on a pilot for a system that will eventually loop over a number of raster files to produce a single output one. If I have two input rasters, the routine works reliably. If I have more than three, it always fails. If I try three after a failure, it fails, but it can be made to work by first resorting to just two inputs and then adding the third. This is my (anonymised) code:

import arcpy
from arcpy.sa import *

arcpy.CheckOutExtension("Spatial")
arcpy.env.extent = "MAXOF"
arcpy.env.overwriteOutput = True
arcpy.env.qualifiedFieldNames = False
arcpy.env.workspace = "C:\aaaa"

inRasDir = bbb\\"
outRasDir = ccc\\"

terms = {}
terms = {
     'first'  : ['0.025', '*', '+', ],
     'second' : ['0.025', '*', '+', ],
     'third'  : ['0.025', '*', '+', ],
     'fourth'  : ['0.15',  '*', '-']
    }

def coeff(lyr):
    if terms[lyr][2] == '+':
        c = float(terms[lyr][0])
    else:
        c = -float(terms[lyr][0])
    return c;

outRas = ((
             (coeff('first')  * Raster(inRasDir + "first"))
           + (coeff('second') * Raster(inRasDir + "second"))
           + (coeff('third')  * Raster(inRasDir + "third"))
#           + (coeff('fourth')  * Raster(inRasDir + "fourth"))
            )
#           * 'fifth'
           )

outRas.save(outRasDir + "finalRas")‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

The error on the last line is:

    outRas.save(outRasDir + "finalRas")
RuntimeError: ERROR 999998: Unexpected Error.‍‍

I also tried using CellStatistics but that also failed on the save statement.

Any comments would be gratefully received.

Regards,

Ian

Re: arcpy.sa save random ERROR 999998: Unexpected Error

DanPatterson_Retired — Fri, 10 Dec 2021 22:22:17 GMT

It is hard to tell with your anon-stuff but this certainly doesn't work...

You need to use raw formatting for paths or os.join

"C:\aaaa" + "finalRas"
'C:\x07aaafinalRas'  # ---- not good

"C:\aaaa\" + "finalRas"
'C:\x07aaafinalRas'
  File "<ipython-input-11-8b220ffe2f0d>", line 1
    "C:\aaaa\" + "finalRas"
                         ^
SyntaxError: invalid syntax

# This works
# ---- you need raw formatting or use forward slashes in the pathe
r"C:\aaaa" + r"\finalRas"
Out[12]: 'C:\\aaaa\\finalRas'‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: arcpy.sa save random ERROR 999998: Unexpected Error

IanMCDONALD — Sun, 17 Jun 2018 08:00:56 GMT

Hi Dan. Thanks for your prompt response.

It was working, as far as the path definition was concerned (see the '\\' at the end of the inRasDir and outRasDir definitions). It was generating an output raster in the directory I expected and I could view it in ArcMap.

I have taken your advice and tried both the raw formatting and forward slashes but the outcome is the same. I can produce an output raster from up to three inputs but not four. If it fails with four, and I immediately try with three, it fails. If I wait for about a minute, without altering the code, it succeeds with three.

Re: arcpy.sa save random ERROR 999998: Unexpected Error

DanPatterson_Retired — Fri, 10 Dec 2021 22:22:19 GMT

I suspect system resources then...

but simplify things

import arcpy

a = np.random.randint(0,10, size=(3,3))*0.1

b = a*2

c = a*np.random.rand()

d = a*np.random.rand()

func = a + 1.0 + b * 2 - c + d/2

func
Out[14]: 
array([[3.24388419, 5.03899154, 2.34633051],
       [3.24388419, 5.03899154, 4.5902147 ],
       [4.5902147 , 3.69266102, 1.44877684]])‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Now, replace a, b, c, d with

RasterToNumPyArray—Help | ArcGIS Desktop

RasterToNumPyArray (in_raster, {lower_left_corner}, {ncols}, {nrows}, {nodata_to_value})

and func with

NumPyArrayToRaster—Help | ArcGIS Desktop

NumPyArrayToRaster (in_array, {lower_left_corner}, {x_cell_size}, {y_cell_size}, {value_to_nodata})

Equivalent functions exist in PRO.

I have tons of NumPy examples on my blog

Re: arcpy.sa save random ERROR 999998: Unexpected Error

IanMCDONALD — Mon, 18 Jun 2018 07:41:46 GMT

Yes, I was beginning to think memory management might be a problem. I have taken your advice to simplify my test system. It is now just a simple loop summing all the rasters. The erratic behaviour appears to have been resolved by using a 64-bit version of Python.

Re: arcpy.sa save random ERROR 999998: Unexpected Error

IanMCDONALD — Wed, 20 Mar 2019 01:00:27 GMT

This problem was resolved for 32-bit implementations by ArcMap 10.6.1.

Re: arcpy.sa save random ERROR 999998: Unexpected Error

curtvprice — Wed, 20 Mar 2019 02:04:53 GMT

This sounds like the issue patched in 10.5.1 (I was one of the complainers)

ArcGIS 10.5.1 (Desktop, Engine, Server) Spatial Analyst Zonal Statistics Tool Patch

Re: arcpy.sa save random ERROR 999998: Unexpected Error

IanMCDONALD — Wed, 20 Mar 2019 05:35:12 GMT

Yes, I only read that recently. Apparently, the fix didn't make it into 10.6 which is were I came in!

Re: arcpy.sa save random ERROR 999998: Unexpected Error

DanPatterson_Retired — Wed, 20 Mar 2019 06:01:21 GMT

BUG-000109772: The Spatial Analyst tools intermittently throw the ".. is the link, 10.6.1 apparently fixed