topic Re: arcpy.sa.Spline issues in BETA2 in ArcGIS Runtime SDK for WPF (Retired) Questions

arcpy.sa.Spline issues in BETA2

BKuiper — Mon, 27 Feb 2012 17:22:14 GMT

the arcpy.sa.Spline function in BETA 2 has some issues:

- the %scratchworkspace% variable is not populated. The %scratchworkspace% value is not replaced with the actual location of your scratchworkspace.
- A temporary file is created (spline_selecXX) in the parent directory of the specified input file.

Not sure if the later can be really considered a bug, but i was surprised to see this behavior.

Can you confirm these issues ? I can send you an example, but this should be really easy to replicate.

ps: I'm running arcpy.sa.Spline through a python script, in ArcCatalog.

Re: arcpy.sa.Spline issues in BETA2

MichaelBranscomb — Tue, 28 Feb 2012 08:23:28 GMT

Hi,

If you can send an example that would be much appreciated. Either attach to this thread or send to mbranscomb@esri.com.

Cheers

Mike

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Tue, 28 Feb 2012 13:27:06 GMT

I'm running the following script

--- SplineExample.py
# -*- coding: utf-8 -*-
# ---------------------------------------------------------------------------
# SplineExampleScript.py
# Created on: 2012-02-28 10:11:31.00000
# (generated by ArcGIS/ModelBuilder)
# Description:
# ---------------------------------------------------------------------------

# Import arcpy module
import arcpy
from arcpy import env
from arcpy.sa import *

# Check out any necessary licenses
arcpy.CheckOutExtension("spatial")

# Local variables:
selection0 = "selection0"
Z_value_field = "inmval"
Weight = "0.1"
Number_of_points = "12"
Output_raster = "C:\\YourDirectory\\Spline_selec3"
dstfile = "%scratchworkspace%\\Spline_selec3"

outSpline = Spline(selection0, "inmval", weight="0.1", number_points=24, spline_type="REGULARIZED")
outSpline.save(dstfile)
---

Just save it somewhere and include it in a Toolbox.

I use the attached shapefile and run it from ArcMap or ArcCatalog to demonstrate the problem.

The problem is that the %scratchworkspace% will not be populated with the value as specified in Geoprocessing->Environments->Workspace

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Tue, 28 Feb 2012 13:28:50 GMT

Here is an example what goes wrong:

Executing: Spline
Start Time: Tue Feb 28 10:14:00 2012
Running script Spline...

Traceback (most recent call last):
File "C:\MyDirectory\Toolbox\SplineExampleScript.py", line 28, in <module>
outSpline = Spline(selection0, "inmval", weight="0.1", number_points=24, spline_type="REGULARIZED")
RuntimeError: ERROR 000875: Output raster: c:\windows\system32\%scratchworkspace%\Spline_selec3's workspace is an invalid output workspace.

Failed to execute (Spline).
Failed at Tue Feb 28 10:14:02 2012 (Elapsed Time: 2.00 seconds)

normally %scratchworkspace% should be replaced with the directory specified in the geoprocessing environment and the c:\windows\system32 shouldn't be there.

Re: arcpy.sa.Spline issues in BETA2

KevinHibma — Tue, 28 Feb 2012 14:42:22 GMT

(I'm coming at this from the GP side - not so much the Runtime side)

Can you try replacing the %scratchworkspace% variable with %scratchFolder% and re-creating your gpk?

We've had issues (and I dont recall when we've fixed them exactly) where inline variables, like scratchworkspace were not being evaluated.
Even though scratchFolder is derived from scratchworkspace, they are handled in slightly different ways during the package creation process, thus might be behave differently on consumption.

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Tue, 28 Feb 2012 14:51:17 GMT

Hi Kevin,

You are right, this is not really a ArcGIS Runtime problem i guess. You mention changing the scratchworkspace to scratchFolder and then recreating the GPK, but actually i didn't create a GPK yet. I'm experiencing this problem when just running the Script from a Toolbox within ArcMap and/or ArcCatalog.

Changing it to scratchFolder doesn't solve the issue.

Executing: Spline
Start Time: Tue Feb 28 11:50:21 2012
Running script Spline...

Traceback (most recent call last):
File "C:\AEDT_Repository\Developers\Foliage\ATMP\INMWeb\MAIN\Toolbox\SplineExampleScript.py", line 22, in <module>
outSpline = Spline(selection0, "inmval", weight="0.1", number_points=24, spline_type="REGULARIZED")
RuntimeError: ERROR 000875: Output raster: c:\windows\system32\%scratchFolder%\Spline_selec3's workspace is an invalid output workspace.

Failed to execute (Spline).
Failed at Tue Feb 28 11:50:22 2012 (Elapsed Time: 1.00 seconds)

Note that i'm still running BETA 2 as i'm waiting for Runtime to hit Pre-release.

Here is the script that i tried:

# -*- coding: utf-8 -*-
# ---------------------------------------------------------------------------
# SplineExampleScript.py
# Created on: 2012-02-28 10:11:31.00000
# (generated by ArcGIS/ModelBuilder)
# Description:
# ---------------------------------------------------------------------------

# Import arcpy module
import arcpy
from arcpy import env
from arcpy.sa import *

# Check out any necessary licenses
arcpy.CheckOutExtension("spatial")

# Local variables:
selection0 = "selection0"
dstfile = "%scratchFolder%\\Spline_selec3"

outSpline = Spline(selection0, "inmval", weight="0.1", number_points=24, spline_type="REGULARIZED")
outSpline.save(dstfile)

Re: arcpy.sa.Spline issues in BETA2

KevinHibma — Sun, 12 Dec 2021 00:13:21 GMT

Its obvious I havent had enough coffee yet... I just assumed this was on the consumption of the GPK.
My machine is updating, so I cant test your exact scenario right now, but the following code should work.
Notice the line I commented out and replaced with "almost" the same thing.

# Import arcpy module
import arcpy
from arcpy import env
from arcpy.sa import *

# Check out any necessary licenses
arcpy.CheckOutExtension("spatial")


# Local variables:
selection0 = "selection0"
dstfile = arcpy.env.scratchFolder + "Spline_selec3"
#dstfile = "%scratchFolder%\\Spline_selec3"

outSpline = Spline(selection0, "inmval", weight="0.1", number_points=24, spline_type="REGULARIZED")
outSpline.save(dstfile)

Re: arcpy.sa.Spline issues in BETA2

KevinHibma — Tue, 28 Feb 2012 14:56:54 GMT

Actually, this would be better than constructing paths with "+"

dstfile = os.path.join(arcpy.env.scratchFolder, "Spline_selec3")

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Tue, 28 Feb 2012 19:02:38 GMT

Great, that works. Both scratchWorkspace and scratchFolder can be used.

Nice workaround/trick for now.

here is the final example script:

# -*- coding: utf-8 -*-
# ---------------------------------------------------------------------------
# SplineExampleScript.py
# Created on: 2012-02-28 10:11:31.00000
# (generated by ArcGIS/ModelBuilder)
# Description:
# ---------------------------------------------------------------------------

# Import arcpy module
import arcpy, os
from arcpy import env
from arcpy.sa import *

# Check out any necessary licenses
arcpy.CheckOutExtension("spatial")

# Local variables:
selection0 = "selection0"
Z_value_field = "inmval"
Weight = "0.1"
Number_of_points = "12"
Output_raster = "C:\\YourDirectory\\Spline_selec3"
#dstfile = "%scratchFolder%\\Spline_selec3"
#dstfile = os.path.join(arcpy.env.scratchFolder, "Spline_selec3")
dstfile = os.path.join(arcpy.env.scratchWorkspace, "Spline_selec3")

outSpline = Spline(selection0, "inmval", weight="0.1", number_points=24, spline_type="REGULARIZED")
outSpline.save(dstfile)

Re: arcpy.sa.Spline issues in BETA2

KevinHibma — Tue, 28 Feb 2012 19:30:26 GMT

I was just made aware this is logged, heres the tracking number:
NIM077457 - Raster save errors when using "%scratchworkspace%" in output path.

Note - this is not fixed in the pre-release. You'll have to continue using the workaround till final. Sorry for the inconvenience, but big thanks on testing and reporting!

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Tue, 28 Feb 2012 22:29:17 GMT

Great, thanks for the feedback. I love what Esri does on these forums.

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Thu, 01 Mar 2012 17:03:35 GMT

Ok, next step. Now i'm trying to run my GPK, Geoprocessing Package, within ArcGIS Runtime, but it fails with the following error:

description=ERROR 000856: An error was encountered while executing Spline.
Failed to execute (Spline).

It works correctly within ArcMap and/or ArcCatalog.

First of all, an error message like that is not really helpful:

000856 : An error was encountered while executing <value>.
Resource Center
Description
There was a problem encountered while executing the specified tool. There are several possible causes for this situation, so you might need to investigate several possibilities to resolve it.
Solution
Check that the syntax is correct, the input datasets exist as specified and are valid, and that you are able to write to the output location.
Ensure that you have sufficient resources on your machine to complete the process.
Check the documentation for any notes or usage tips that may apply.
Contact technical support for assistance if you still cannot resolve the problem.

I thought it might be a license issue, so i used the Local Runtime License Viewer to generate my "Testing C#, Spatial Extension license" and copy/paste that into my app. This didn't change anything.

Any idea on what could be the problem ? The input file exists. Could it be that Spline is not supported correctly although the BETA 2 documentation suggests it is ?

this is against BETA 2.

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Sun, 12 Dec 2021 00:13:23 GMT

Here is the code that i use against the selection file that was already supplied in this thread.

# -*- coding: utf-8 -*-
# ---------------------------------------------------------------------------
# SplineExampleScript.py
# Created on: 2012-03-01 14:43:43.00000
#   (generated by ArcGIS/ModelBuilder)
# Usage: SplineExampleScript <selection0> <Z_value_field> <Spline_sele37> 
# Description: 
# ---------------------------------------------------------------------------

# Import arcpy module
import arcpy, os

# Check out any necessary licenses
arcpy.CheckOutExtension("spatial")

# Script arguments
selection0 = arcpy.GetParameterAsText(0)
if selection0 == '#' or not selection0:
    selection0 = "selection0" # provide a default value if unspecified

Z_value_field = arcpy.GetParameterAsText(1)
if Z_value_field == '#' or not Z_value_field:
    Z_value_field = "inmval" # provide a default value if unspecified

# overwrite existing files
arcpy.gp.overwriteOutput = 1


# Local variables:
Spline_sele37 = os.path.join(arcpy.env.scratchWorkspace, "scratch.gdb\\result")

# Process: Spline
try:
    arcpy.gp.Spline_sa(selection0, "inmval", Spline_sele37)
except Exception as e:
    msgs = arcpy.GetMessages(2)
    arcpy.AddError(msgs)
    arcpy.AddError(e.message)
    sys.exit()

arcpy.SetParameter(2, Spline_sele37)

Attached is the Spline.gpk

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Tue, 06 Mar 2012 12:02:07 GMT

Can somebody at Esri confirm this issue with the SA Spline method ?

Re: arcpy.sa.Spline issues in BETA2

MichaelBranscomb — Tue, 06 Mar 2012 15:10:20 GMT

Hi,

Unfortunately I have not been able to successfully test your Spline script example but I can confirm that the Spline tool (Spatial Analyst > Interpolation) is a supported tool and has been successfully tested.

Cheers

Mike

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Thu, 08 Mar 2012 13:22:33 GMT

Attached is an complete example that shows it is not working on ArcGIS Runtime BETA 2.

So, to summarize, it works as a Python script in ArcCatalog but as soon as it is packaged and run through Runtime I get the following error:

error:

Submitted.
Executing...
Executing (Script): Script C:\..\PoCSplineRuntime\shapefile\selection\selection0.shp
Start Time: Thu Mar 08 10:21:23 2012
Executing (Script): Script C:\..\PoCSplineRuntime\shapefile\selection\selection0.shp
Start Time: Thu Mar 08 10:21:23 2012
Executing (Script): Script C:\..\PoCSplineRuntime\shapefile\selection\selection0.shp
Start Time: Thu Mar 08 10:21:23 2012
Running script Script...
Workspace: c:\users\..\appdata\local\temp\arcgisruntime_7212\script\jobs\script_gpserver\jb9264a9300464798a84f4c3ef0b687d3\scratch
Output file: c:\users\..\appdata\local\temp\arcgisruntime_7212\script\jobs\script_gpserver\jb9264a9300464798a84f4c3ef0b687d3\scratch\result
ERROR 000856: An error was encountered while executing Spline.
Failed to execute (Spline).

Re: arcpy.sa.Spline issues in BETA2

MichaelBranscomb — Tue, 13 Mar 2012 14:05:42 GMT

Hi,

Sorry for the delay in getting back to you on this. Thanks for the excellent reproducer. I have tested with the latest ArcGIS Runtime local server and the latest WPF client assemblies and (without modification) your app produces the output below and [I think] a valid spline result (see attached screenshot of the result back in ArcMap). I believe this indicates you should be able to retest successfully in pre-release. You may just need to play around with the script to get the right output parameter (GPRasterData / GPDataFile) - or better would be a map server result which would then allow you to add the raster directly to the map as a dynamic map service layer. Alternatively, the dynamic layers functionality you were testing previously could be used to dynamically add rasters to an existing map service at runtime.

Submitted.
Executing...
Executing (Script): Script C:\WORK\PROJECTS\ArcGISRuntimeCRs\SplineTest\PoCSplineRuntime\shapefile\selection\selection0.shp
Start Time: Tue Mar 13 14:54:47 2012
Executing (Script): Script C:\WORK\PROJECTS\ArcGISRuntimeCRs\SplineTest\PoCSplineRuntime\shapefile\selection\selection0.shp
Start Time: Tue Mar 13 14:54:47 2012
Executing (Script): Script C:\WORK\PROJECTS\ArcGISRuntimeCRs\SplineTest\PoCSplineRuntime\shapefile\selection\selection0.shp
Start Time: Tue Mar 13 14:54:47 2012
Running script Script...
Workspace: c:\users\mbrans~1\appdata\local\temp\arcgisruntime_5020\script\jobs\script_gpserver\j38850bacf654422babed8dc177344f58\scratch
Output file: c:\users\mbrans~1\appdata\local\temp\arcgisruntime_5020\script\jobs\script_gpserver\j38850bacf654422babed8dc177344f58\scratch\result
Completed script Script...
Succeeded at Tue Mar 13 14:54:48 2012 (Elapsed Time: 1.00 seconds)
Succeeded at Tue Mar 13 14:54:48 2012 (Elapsed Time: 1.00 seconds)
Succeeded at Tue Mar 13 14:54:48 2012 (Elapsed Time: 1.00 seconds)
Invalid return value: c:\users\mbrans~1\appdata\local\temp\arcgisruntime_5020\script\jobs\script_gpserver\j38850bacf654422babed8dc177344f58\scratch\result
Failed.

Cheers

Mike

Re: arcpy.sa.Spline issues in BETA2

BKuiper — Wed, 14 Mar 2012 13:28:50 GMT

Thanks. looking forward to ArcGIS Runtime Prerelease.

Re: arcpy.sa.Spline issues in BETA2

SusanJones — Tue, 02 Oct 2012 22:00:40 GMT

Howzit All,

Has anyone got a solution for ArcGIS Server 10.1 to this issue?

We have a similar situation

Geoprocssing Overview:
- create a Feature Layer from a sql expression
- generate Kernel Density Layer
- set Layer into resulting Dynamic Map Service Layer as a Raster Layer

If the feature layer returns no records, then no result is returned and the GP Service fails because it cannot add the "Invalid" null result to the map.

Setting arcpy.SetSeverityLevel(0) ensures the task completes.

I think the problem occurs at the map services level because the task completes.

Susan

North South GIS
Auckland, New Zealand