idea Rebuild Scene Layer Cache with Python API in Developers Ideas

Rebuild Scene Layer Cache with Python API

JustinReynolds — Sun, 12 Apr 2020 04:59:59 GMT

It would be helpful to expose the "Manage Cache" functionality for a Scene Layer - 3D Object with the ArcGIS Python API so that updating the scene layer cache to reflect any changes made in the feature layer used to publish the scene layer can be done programmatically.

I have a workflow where many edits are made to attributes that control symbology on the feature layer used to publish the scene layer. The new symbology needs to be reflected in the web scene. It would be preferably to do this on some set interval, likely several times a day with a scheduled task or after some volume of edits via web hook rather than rely on a user to remember to do it manually.

Also see,

https://community.esri.com/ideas/14830-update-hostet-scene-layers#comment-82270

Re: Rebuild Scene Layer Cache with Python API

JustinReynolds — Mon, 12 Apr 2021 13:33:56 GMT

Update: Although this hasn't been exposed in the ArcGIS Python API (to my knowledge), we where able to script this using Python and the ArcGIS Rest API.

Re: Rebuild Scene Layer Cache with Python API

vipapril — Fri, 16 Apr 2021 03:51:36 GMT

Hi @JustinReynolds

Can you share more on the REST API commands for this?

Re: Rebuild Scene Layer Cache with Python API

PierreMarcombe — Wed, 28 Apr 2021 13:32:20 GMT

Hi @JustinReynolds , thanks for your feedback. In my situation, I also confirm that via the web interface of the rest api (.../arcgis/rest/services/System/SceneCachingControllers/GPServer/Manage%20Scene%20Cache/submitJob) everything works well. However, when I try to submit this job via an external app (Integromat for example), the job is nicely created and lauched but quite quickly it fails, indicating an error (esriJobMessageTypeError: ERROR 001812: Unable to connect to the database used for scene caches (In-server connection failed. Server is federated but server environment doesn't have token or referer.)".
Can you please provide the way you triggered it via the rest api ? On my side, I used a POST method, with url-encoded fields :

Also, when you say that you submit the job via python, did you launch your python script directly from the arcgis server machine (assuming that you're on a arcgis entreprise deployment) ?

Have a good one,

Pierre

Re: Rebuild Scene Layer Cache with Python API

DallasShearer225 — Wed, 28 Apr 2021 14:17:54 GMT

Pierre here are some of the key inputs in the request to rebuild the cache, hope this helps...

_referer_url = "https://{}".format(host) submit_url = "https://{}/server/rest/services/System/SceneCachingControllers/GPServer/Manage%20Scene%20Cache/submitJob?.format(host) service_url = '{}/server/rest/services/Hosted/{}/SceneServer'.format(_referer_url, service_name) params = {'service_url': service_url, 'num_of_caching_service_instances': 2, 'layer': {}, 'update_mode': 'RECREATE_ALL_NODES', 'update_extent': 'DEFAULT', 'area_of_interest': {"displayFieldName": "", "geometryType": "esriGeometryPolygon", "spatialReference": {"wkid": 54051, "latestWkid": 54051}, "fields": [{"name": "OID", "type": "esriFieldTypeOID", "alias": "OID"}, {"name": "updateGeom_Length", "type": "esriFieldTypeDouble","alias": "updateGeom_Length"}, {"name": "updateGeom_Area", "type": "esriFieldTypeDouble", "alias": "updateGeom_Area"}], "features": [], "exceededTransferLimit": False}, 'f': 'json', 'token': self.token} headers = {"Referer": self._referer_url} request = urllib.request.Request(submit_url, data=self._encode_data(params), headers=headers) with contextlib.closing(urllib.request.urlopen(request)) as response: content = response.read() content_decoded = content.decode("utf-8") result = json.loads(content_decoded) print(result)

Re: Rebuild Scene Layer Cache with Python API

JustinReynolds — Wed, 28 Apr 2021 15:18:16 GMT

@PierreMarcombe @vipapril See the comment from Dallas above.

Re: Rebuild Scene Layer Cache with Python API

vipapril — Thu, 29 Apr 2021 01:16:15 GMT

Thank you all!

Re: Rebuild Scene Layer Cache with Python API

kristian_inCitu — Fri, 12 Jul 2024 11:51:18 GMT

Hi!
According to documentation this should be possible wit Python SDK also.
However it does not work. No Job is started and the return of the function are the attributes.
Is there a way to handle the SceneLayer cache without using REST API in Python?
Thanks!

rebuild = scene_manager.rebuild_cache(0) print(rebuild) OUTPUT: {'name': 'SceneLayer_840 demo_dlxz', 'supportedBindings': ['REST'], 'serviceVersion': '1.9', 'serviceItemId': '64bd786bf842429b85a2d87afb52f3d8', 'layers': [{'id': 0, 'version': '1D06551A-6BC8-4C90-BEE6-DC0B0D2EF18F', 'name': 'new_feature_local', 'serviceUpdateTimeStamp': {'lastUpdate': 373298}, 'href': './layers/0', 'associatedLayerID': 0, 'layerType': '3DObject', 'spatialReference': {'wkid': 102100, 'latestWkid': 3857}, 'ZFactor': 1, 'alias': 'new_feature_local', 'capabilities': ['View', 'Query'], 'cachedDrawingInfo': {'color': False}, 'drawingInfo': {'renderer': {'type': 'simple', 'symbol': {'type': 'MeshSymbol3D', 'symbolLayers': [{'material': {'color': [255, 255, 255], 'transparency': 0}, 'pattern': {'type': 'style', 'style': 'solid'}, 'type': 'Fill', 'outline': {'size': 1, 'color': [110, 110, 110], 'transparency': 0}}]}}}, 'popupInfo': {'title': '{name}', 'mediaInfos': [], 'fieldInfos': [{'fieldName': 'OBJECTID', 'label': 'OBJECTID', 'visible': True}, {'fieldName': 'GlobalID', 'label': 'GlobalID', 'visible': True}, {'fieldName': 'ESRI3DO_TYPE', 'label': 'Asset Type', 'visible': True}, {'fieldName': 'ESRI3DO_SHASH', 'label': 'Source Hash', 'visible': True}, {'fieldName': 'ESRI3DO_OX', 'label': '3D Asset Origin X [SR]', 'visible': True}, {'fieldName': 'ESRI3DO_OY', 'label': '3D Asset Origin Y [SR]', 'visible': True}, {'fieldName': 'ESRI3DO_OZ', 'label': '3D Asset Origin Z [SR]', 'visible': True}, {'fieldName': 'ESRI3DO_TX', 'label': '3D Translation X', 'visible': True}, {'fieldName': 'ESRI3DO_TY', 'label': '3D Translation Y', 'visible': True}, {'fieldName': 'ESRI3DO_TZ', 'label': '3D Translation Z', 'visible': True}, {'fieldName': 'ESRI3DO_SX', 'label': '3D Scale X', 'visible': True}, {'fieldName': 'ESRI3DO_SY', 'label': '3D Scale Y', 'visible': True}, {'fieldName': 'ESRI3DO_SZ', 'label': '3D Scale Z', 'visible': True}, {'fieldName': 'ESRI3DO_RX', 'label': '3D Rotation Direction X', 'visible': True}, {'fieldName': 'ESRI3DO_RY', 'label': '3D Rotation Direction Y', 'visible': True}, {'fieldName': 'ESRI3DO_RZ', 'label': '3D Rotation Direction Z', 'visible': True}, {'fieldName': 'ESRI3DO_RDEG', 'label': '3D Rotation in Degrees', 'visible': True}, {'fieldName': 'projectId', 'label': 'projectId', 'visible': True}, {'fieldName': 'latitude', 'label': 'latitude', 'visible': True}, {'fieldName': 'longitude', 'label': 'longitude', 'visible': True}, {'fieldName': 'altitude', 'label': 'altitude', 'visible': True}, {'fieldName': 'rotation', 'label': 'rotation', 'visible': True}], 'popupElements': [{'type': 'fields'}]}, 'disablePopup': False, 'store': {'id': '3D0C09A8-781B-408D-A434-22B757ABAB2C', 'profile': 'meshpyramids', 'resourcePattern': ['3dNodeIndexDocument', 'Attributes', 'SharedResource', 'Geometry'], 'rootNode': './nodes/root', 'version': '1.9', 'extent': [-8232181.988441467, 4971395.488534927, -8232049.780246735, 4971527.696722031], 'indexCRS': 'http://www.opengis.net/def/crs/EPSG/0/3857', 'vertexCRS': 'http://www.opengis.net/def/crs/EPSG/0/3857', 'normalReferenceFrame': 'vertex-reference-frame', 'textureEncoding': ['image/jpeg', 'image/vnd-ms.dds'], 'lodType': 'MeshPyramid', 'lodModel': 'node-switching', 'defaultGeometrySchema': {'geometryType': 'triangles', 'header': [{'property': 'vertexCount', 'type': 'UInt32'}, {'property': 'featureCount', 'type': 'UInt32'}], 'topology': 'PerAttributeArray', 'ordering': ['position', 'normal', 'uv0', 'color', 'region'], 'vertexAttributes': {'position': {'valueType': 'Float32', 'valuesPerElement': 3}, 'normal': {'valueType': 'Float32', 'valuesPerElement': 3}, 'uv0': {'valueType': 'Float32', 'valuesPerElement': 2}, 'color': {'valueType': 'UInt8', 'valuesPerElement': 4}, 'region': {'valuesPerElement': 4, 'valueType': 'UInt16'}}, 'featureAttributeOrder': ['id', 'faceRange'], 'featureAttributes': {'id': {'valueType': 'UInt64', 'valuesPerElement': 1}, 'faceRange': {'valueType': 'UInt32', 'valuesPerElement': 2}}}}, 'fields': [{'name': 'OBJECTID', 'type': 'esriFieldTypeOID', 'alias': 'OBJECTID'}, {'name': 'GlobalID', 'type': 'esriFieldTypeGlobalID', 'alias': 'GlobalID'}, {'name': 'ESRI3DO_TYPE', 'type': 'esriFieldTypeString', 'alias': 'Asset Type'}, {'name': 'ESRI3DO_SHASH', 'type': 'esriFieldTypeString', 'alias': 'Source Hash'}, {'name': 'ESRI3DO_OX', 'type': 'esriFieldTypeDouble', 'alias': '3D Asset Origin X [SR]'}, {'name': 'ESRI3DO_OY', 'type': 'esriFieldTypeDouble', 'alias': '3D Asset Origin Y [SR]'}, {'name': 'ESRI3DO_OZ', 'type': 'esriFieldTypeDouble', 'alias': '3D Asset Origin Z [SR]'}, {'name': 'ESRI3DO_TX', 'type': 'esriFieldTypeDouble', 'alias': '3D Translation X'}, {'name': 'ESRI3DO_TY', 'type': 'esriFieldTypeDouble', 'alias': '3D Translation Y'}, {'name': 'ESRI3DO_TZ', 'type': 'esriFieldTypeDouble', 'alias': '3D Translation Z'}, {'name': 'ESRI3DO_SX', 'type': 'esriFieldTypeDouble', 'alias': '3D Scale X'}, {'name': 'ESRI3DO_SY', 'type': 'esriFieldTypeDouble', 'alias': '3D Scale Y'}, {'name': 'ESRI3DO_SZ', 'type': 'esriFieldTypeDouble', 'alias': '3D Scale Z'}, {'name': 'ESRI3DO_RX', 'type': 'esriFieldTypeDouble', 'alias': '3D Rotation Direction X'}, {'name': 'ESRI3DO_RY', 'type': 'esriFieldTypeDouble', 'alias': '3D Rotation Direction Y'}, {'name': 'ESRI3DO_RZ', 'type': 'esriFieldTypeDouble', 'alias': '3D Rotation Direction Z'}, {'name': 'ESRI3DO_RDEG', 'type': 'esriFieldTypeDouble', 'alias': '3D Rotation in Degrees'}, {'name': 'projectId', 'type': 'esriFieldTypeString', 'alias': 'projectId'}, {'name': 'latitude', 'type': 'esriFieldTypeDouble', 'alias': 'latitude'}, {'name': 'longitude', 'type': 'esriFieldTypeDouble', 'alias': 'longitude'}, {'name': 'altitude', 'type': 'esriFieldTypeDouble', 'alias': 'altitude'}, {'name': 'rotation', 'type': 'esriFieldTypeDouble', 'alias': 'rotation'}], 'attributeStorageInfo': [{'key': 'f_0', 'name': 'OBJECTID', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['ObjectIds'], 'objectIds': {'valueType': 'UInt32', 'valuesPerElement': 1}}, {'key': 'f_1', 'name': 'GlobalID', 'header': [{'property': 'count', 'valueType': 'UInt32'}, {'property': 'attributeValuesByteCount', 'valueType': 'UInt32'}], 'ordering': ['attributeByteCounts', 'attributeValues'], 'attributeByteCounts': {'valueType': 'UInt32', 'valuesPerElement': 1}, 'attributeValues': {'valueType': 'String', 'encoding': 'UTF-8', 'valuesPerElement': 1}}, {'key': 'f_2', 'name': 'ESRI3DO_TYPE', 'header': [{'property': 'count', 'valueType': 'UInt32'}, {'property': 'attributeValuesByteCount', 'valueType': 'UInt32'}], 'ordering': ['attributeByteCounts', 'attributeValues'], 'attributeByteCounts': {'valueType': 'UInt32', 'valuesPerElement': 1}, 'attributeValues': {'valueType': 'String', 'encoding': 'UTF-8', 'valuesPerElement': 1}}, {'key': 'f_3', 'name': 'ESRI3DO_SHASH', 'header': [{'property': 'count', 'valueType': 'UInt32'}, {'property': 'attributeValuesByteCount', 'valueType': 'UInt32'}], 'ordering': ['attributeByteCounts', 'attributeValues'], 'attributeByteCounts': {'valueType': 'UInt32', 'valuesPerElement': 1}, 'attributeValues': {'valueType': 'String', 'encoding': 'UTF-8', 'valuesPerElement': 1}}, {'key': 'f_4', 'name': 'ESRI3DO_OX', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_5', 'name': 'ESRI3DO_OY', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_6', 'name': 'ESRI3DO_OZ', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_7', 'name': 'ESRI3DO_TX', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_8', 'name': 'ESRI3DO_TY', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_9', 'name': 'ESRI3DO_TZ', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_10', 'name': 'ESRI3DO_SX', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_11', 'name': 'ESRI3DO_SY', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_12', 'name': 'ESRI3DO_SZ', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_13', 'name': 'ESRI3DO_RX', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_14', 'name': 'ESRI3DO_RY', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_15', 'name': 'ESRI3DO_RZ', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_16', 'name': 'ESRI3DO_RDEG', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_17', 'name': 'projectId', 'header': [{'property': 'count', 'valueType': 'UInt32'}, {'property': 'attributeValuesByteCount', 'valueType': 'UInt32'}], 'ordering': ['attributeByteCounts', 'attributeValues'], 'attributeByteCounts': {'valueType': 'UInt32', 'valuesPerElement': 1}, 'attributeValues': {'valueType': 'String', 'encoding': 'UTF-8', 'valuesPerElement': 1}}, {'key': 'f_18', 'name': 'latitude', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_19', 'name': 'longitude', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_20', 'name': 'altitude', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}, {'key': 'f_21', 'name': 'rotation', 'header': [{'property': 'count', 'valueType': 'UInt32'}], 'ordering': ['attributeValues'], 'attributeValues': {'valueType': 'Float64', 'valuesPerElement': 1}}], 'featureidMappedFromFS': 0, 'statisticsInfo': [{'key': 'f_2', 'name': 'ESRI3DO_TYPE', 'href': './statistics/f_2'}, {'key': 'f_3', 'name': 'ESRI3DO_SHASH', 'href': './statistics/f_3'}, {'key': 'f_4', 'name': 'ESRI3DO_OX', 'href': './statistics/f_4'}, {'key': 'f_5', 'name': 'ESRI3DO_OY', 'href': './statistics/f_5'}, {'key': 'f_6', 'name': 'ESRI3DO_OZ', 'href': './statistics/f_6'}, {'key': 'f_7', 'name': 'ESRI3DO_TX', 'href': './statistics/f_7'}, {'key': 'f_8', 'name': 'ESRI3DO_TY', 'href': './statistics/f_8'}, {'key': 'f_9', 'name': 'ESRI3DO_TZ', 'href': './statistics/f_9'}, {'key': 'f_10', 'name': 'ESRI3DO_SX', 'href': './statistics/f_10'}, {'key': 'f_11', 'name': 'ESRI3DO_SY', 'href': './statistics/f_11'}, {'key': 'f_12', 'name': 'ESRI3DO_SZ', 'href': './statistics/f_12'}, {'key': 'f_13', 'name': 'ESRI3DO_RX', 'href': './statistics/f_13'}, {'key': 'f_14', 'name': 'ESRI3DO_RY', 'href': './statistics/f_14'}, {'key': 'f_15', 'name': 'ESRI3DO_RZ', 'href': './statistics/f_15'}, {'key': 'f_16', 'name': 'ESRI3DO_RDEG', 'href': './statistics/f_16'}, {'key': 'f_17', 'name': 'projectId', 'href': './statistics/f_17'}, {'key': 'f_18', 'name': 'latitude', 'href': './statistics/f_18'}, {'key': 'f_19', 'name': 'longitude', 'href': './statistics/f_19'}, {'key': 'f_20', 'name': 'altitude', 'href': './statistics/f_20'}, {'key': 'f_21', 'name': 'rotation', 'href': './statistics/f_21'}], 'nodePages': {'nodesPerPage': 64, 'lodSelectionMetricType': 'maxScreenThresholdSQ'}, 'materialDefinitions': [{'doubleSided': True, 'alphaMode': 'opaque', 'pbrMetallicRoughness': {'metallicFactor': 0}}, {'doubleSided': True, 'alphaMode': 'opaque', 'pbrMetallicRoughness': {'baseColorTexture': {'textureSetDefinitionId': 1, 'texCoord': 0}, 'metallicFactor': 0, 'roughnessFactor': 0.5}}], 'textureSetDefinitions': [{'formats': [{'name': '0', 'format': 'jpg'}, {'name': '0_0_1', 'format': 'dds'}]}, {'atlas': True, 'formats': [{'name': '0', 'format': 'jpg'}, {'name': '0_0_1', 'format': 'dds'}]}], 'geometryDefinitions': [{'geometryBuffers': [{'offset': 8, 'position': {'type': 'Float32', 'component': 3}, 'normal': {'type': 'Float32', 'component': 3}, 'uv0': {'type': 'Float32', 'component': 2}, 'color': {'type': 'UInt8', 'component': 4}, 'featureId': {'type': 'UInt64', 'component': 1, 'binding': 'per-feature'}, 'faceRange': {'type': 'UInt32', 'component': 2, 'binding': 'per-feature'}}, {'compressedAttributes': {'encoding': 'draco', 'attributes': ['position', 'uv0', 'color', 'feature-index']}}]}, {'geometryBuffers': [{'offset': 8, 'position': {'type': 'Float32', 'component': 3}, 'normal': {'type': 'Float32', 'component': 3}, 'uv0': {'type': 'Float32', 'component': 2}, 'color': {'type': 'UInt8', 'component': 4}, 'uvRegion': {'type': 'UInt16', 'component': 4}, 'featureId': {'type': 'UInt64', 'component': 1, 'binding': 'per-feature'}, 'faceRange': {'type': 'UInt32', 'component': 2, 'binding': 'per-feature'}}, {'compressedAttributes': {'encoding': 'draco', 'attributes': ['position', 'uv0', 'color', 'feature-index', 'uv-region']}}]}], 'fullExtent': {'xmin': -8232181.988438139, 'xmax': -8232049.780247221, 'ymin': 4971395.488531021, 'ymax': 4971527.696721939, 'spatialReference': {'wkid': 102100, 'latestWkid': 3857}, 'zmin': 4.78508282, 'zmax': 144.06314373308595}, 'updateEnabled': True, 'lastCached': 1720643617, 'requiresRebuild': False}]}