topic Re: Working in arctoolbox directly with an image service in ArcGIS Image Server Questions

Working in arctoolbox directly with an image service

OlgaKoblet — Wed, 03 Nov 2021 11:38:15 GMT

Hi all,

I need to access a published image service through python and perform some simple operations with it. The example I've written takes a mosaic dataset -> looks for all the images within a specified month -> checks their mean value -> and exports the image with the maximum mean value (attached file). However, I didn't figure out how to do the same starting with the image service. In the data types of the arctoolbox there is a type DEImageServer, but I can't apply the function arcpy.da.SearchCursor to it. So I have to convert somehow the service to a mosaic I guess? Any ideas how? Or should the approach be totally different?

The reason why we do that is that not all of the users have the access to the original data, so we want them to take the image service and then proceed with whatever they are doing.

def execute(self, parameters, messages):
    """The source code of the tool."""
    in_mosaic = parameters[0].valueAsText
    in_month = parameters[1].valueAsText
    output_folder = parameters[2].valueAsText

    # find all the rasters taken within the month identified in the input and check their average value of all cells.
    my_mosaic = os.path.normpath(in_mosaic)
    mean_month = {}
    with arcpy.da.SearchCursor(my_mosaic, ['OBJECTID', 'FILE_DATE']) as cursor:
        for row in cursor:
            month = row[1].date().month
            if int(month) == int(in_month):
                raster = str(my_mosaic) + '/Raster.OBJECTID =' + str(row[0])
                arcpy.CalculateStatistics_management(raster)
                mean_value = arcpy.GetRasterProperties_management(in_raster=raster, property_type='MEAN')
                arcpy.AddMessage(mean_value)
                mean_month[row[0]] = mean_value
    del cursor
    objectid_max_mean = max(mean_month.iteritems(), key=operator.itemgetter(1))[0]
    arcpy.AddMessage(objectid_max_mean)

    #Save the raster with the maximum mean value
    where_clause = "OBJECTID ="  + str(objectid_max_mean)
    arcpy.management.ExportMosaicDatasetItems(my_mosaic, output_folder, "", where_clause, 'TIFF', "", "NONE", "", "")

    return

Re: Working in arctoolbox directly with an image service

ABishop — Wed, 03 Nov 2021 13:06:45 GMT

Hello @OlgaKoblet

I would start with analyzing the image service properties and fields. Your search cursor for the mosaic dataset uses text but it could be different with the published image service. After you determine what the field type is, you may be able to use the same script with different field type parameters.

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Wed, 03 Nov 2021 15:25:03 GMT

Thank you for your message! You mean that I should look for another arcpy function that accesses image service fields?

Re: Working in arctoolbox directly with an image service

ABishop — Wed, 03 Nov 2021 15:27:47 GMT

First you need to bring the image service into your ArcMap or Pro and view the attributes and fields. Make sure the field types are the same as the mosaic dataset. Then you may have to alter the python script to update that field type.

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Wed, 03 Nov 2021 15:39:07 GMT

The image service is already published, and the fields are the same as in the mosaic dataset that was published, but how to access them programmatically? Basically how to iterate through an image service?

Re: Working in arctoolbox directly with an image service

ABishop — Wed, 03 Nov 2021 15:42:39 GMT

@OlgaKoblet

What platform? ArcMap or ArcGIS Pro? Also what version? This will greatly affect the mode and type of script.

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Wed, 03 Nov 2021 15:55:20 GMT

forgot to tag you 🙂 @ABishop

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Wed, 03 Nov 2021 15:56:45 GMT

ArcGIS Pro, 2.8

Re: Working in arctoolbox directly with an image service

ABishop — Wed, 03 Nov 2021 15:58:22 GMT

@OlgaKoblet

Would you be able to share your service with me for testing?

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Wed, 03 Nov 2021 16:02:05 GMT

Wouldn't it be the same for every image service? Just going through the table and collecting the OBJECTIDs in a list, for example?

Re: Working in arctoolbox directly with an image service

ABishop — Wed, 03 Nov 2021 16:04:51 GMT

I am not sure without seeing the data. But here is some information with python snippets: https://pro.arcgis.com/en/pro-app/latest/arcpy/get-started/data-access-using-cursors.htm

Everything else I find is suggesting the use of iterators in Model Builder here: https://pro.arcgis.com/en/pro-app/latest/tool-reference/modelbuilder-toolbox/iterate-row-selection.htm

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Wed, 03 Nov 2021 16:10:46 GMT

Just to be sure: the attached script works without any problems, but if I am to change the input of the function arcpy.da.SearchCursor from mosaic to image service, it doesn't work anymore since this function takes as input only a feature class, layer, table, or table view. Meaning that I either have to convert the image service prior to this step or use some other function for iterating through the image service.

Re: Working in arctoolbox directly with an image service

ABishop — Wed, 03 Nov 2021 17:03:43 GMT

@OlgaKoblet

In the input feature, try pasting the image service URL.

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Thu, 04 Nov 2021 08:54:33 GMT

Mit der URL geht es auch nicht. Vielleicht wäre Python API eine bessere Option?

Re: Working in arctoolbox directly with an image service

Zikang — Mon, 08 Nov 2021 18:50:55 GMT

olga,

There is no simple arcpy solution for this workflow at the moment.

We will need to take advantages of image service rest apis for some of the operations. (or using equivalent arcgis python apis)

For instance, you may use image service "query" operation to get item info to loop through them; you may use image service "compute statistics and histograms" operation to figure out the statistics of them.

https://developers.arcgis.com/rest/services-reference/enterprise/image-service.htm

https://developers.arcgis.com/python/api-reference/arcgis.raster.toc.html#imagerylayer

Why not arcpy? - still using the compute stats as an example, I think arcpy will try to write it back to data, you cannot do it with image service for now. theoretically, you can only do it when you are the admin/publisher of a service.

zikang

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Thu, 11 Nov 2021 13:13:00 GMT

thank you for your message? Do you know if I can just select rasters in the image service (not in the mosaic as I do) based on some attribute, and then export them locally? May be calculating statistics is not a good example. Basically doing in arcpy the manuall steps of selecting the rows in the attribute table of the footprints and then doing "selection -> create layer from selected features".

The limitation (for us) of the ArcGIS API for python is that the services need to be in portal, and not just on the server.

Re: Working in arctoolbox directly with an image service

OlgaKoblet — Thu, 11 Nov 2021 13:15:45 GMT

@PeterBecker may be you have ideas?