nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Overschrijf ArcGIS Online Feature Service met behulp van ArcGIS Pro Project

JakeSkinner

Voorheen schreef ik een document over hoe je een ArcGIS Online feature service kunt overschrijven door te verwijzen naar een feature class en gebruik te maken van een truncate/append methode. Ik ontving veel feedback op dit document, waarbij sommige gebruikers beperkingen ondervonden zoals het niet ondersteunen van attachments, en het bijwerken van services met meerdere lagen. Deze oplossing is bedoeld om deze beperkingen aan te pakken. Hieronder staat een script om een ArcGIS Online feature service te overschrijven door te verwijzen naar een ArcGIS Pro project, en een video over hoe je het script gebruikt. Laat hieronder een reactie achter als er problemen of vragen zijn.<\/P>

Vind meer berichten getagd met

Reacties

ModernElectric

@JakeSkinner

This version is working great. Been working with it all week on my electric and water dataset(s). All of my relationship classes stay intact and the attachments are all loaded after running the script. Will continue to work with it and develop my update workflow and let you know if I run into any new issues or bugs.

As of now, the Hosted Feature Layers are used in a web map being used in Field Maps. We are also using ESRI Workforce for our field crews and those maps/datasets need to have sync enabled, I am curious on adding those feature layers to some of our Workforce Projects and seeing how this update procedure works.

Appreciate your help!!

KatGIS

Hi @JakeSkinner,

Thank you so much for this updated script!

It's exactly what we have been attempting to keep sync enabled and not break the replicas, and also overwrite the HFL with attachments.

Unfortunately I am running into an issue once testing it with an offline layer in Field Maps. The script runs perfectly before adding it to Field Maps (I believe before creating any replicas?).

But in the "Overwrite Feature Service" block, I receive this error:

---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
In  [65]:
Line 9:     fs = sdItem.publish(overwrite=True)

File C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\gis\__init__.py, in publish:
Line 12740: elif not buildInitialCache and ret[0]["type"].lower() == "image service":

KeyError: 'type'
---------------------------------------------------------------------------

I removed the replica by removing it from Field Maps, and tested the script again and it still works.

We have field workers offline for days at a time, so this is a roadblock.

The script is the same besides the fact I must sign into AGOL through Pro gis = GIS("pro") in order to bypass mandatory Multi-Factor Authentication.

Any idea how this error could be resolved?

Greatly appreciate your help! 🙂

DJB

@JakeSkinner

I've been using very similar code to overwrite service on a nightly basis. Up until this morning it has been working great. I now get a warning that item.share has been deprecated and that I now need to use item.sharing.

DeprecatedWarning: share is deprecated as of 2.3.0 and has be removed in 3.0.0. Use `Item.sharing` instead.

I'm having a hard time following the documentation that describes the new sharing module.

If you have any suggestions or material that outlines how to update the sharing to everyone I would greatly appreciate it.

I did find an example where the sddraft XML is altered but that seems like a step backwards and requires a lot more code for what use to take just a couple lines of code.

# Read the .sddraft file
docs = DOM.parse(sddraft_output_filename)
key_list = docs.getElementsByTagName('Key')
value_list = docs.getElementsByTagName('Value')

# Change following to "true" to share
SharetoOrganization = "false"
SharetoEveryone = "true"
SharetoGroup = "false"
# If SharetoGroup is set to "true", uncomment line below and provide group IDs
GroupID = ""    # GroupID = "f07fab920d71339cb7b1291e3059b7a8, e0fb8fff410b1d7bae1992700567f54a"

# Each key has a corresponding value. In all the cases, value of key_list[i] is value_list[i].
for i in range(key_list.length):
    if key_list[i].firstChild.nodeValue == "PackageUnderMyOrg":
        value_list[i].firstChild.nodeValue = SharetoOrganization
    if key_list[i].firstChild.nodeValue == "PackageIsPublic":
        value_list[i].firstChild.nodeValue = SharetoEveryone
    if key_list[i].firstChild.nodeValue == "PackageShareGroups":
        value_list[i].firstChild.nodeValue = SharetoGroup
    if SharetoGroup == "true" and key_list[i].firstChild.nodeValue == "PackageGroupIDs":
        value_list[i].firstChild.nodeValue = GroupID

This is how I use to do it.

# Set sharing options
shrOrg = True
shrEveryone = True
shrGroups = ""

if shrOrg or shrEveryone or shrGroups:
    print("Setting sharing options…")
    fs.share(org=shrOrg, everyone=shrEveryone, groups=shrGroups)

Thank you

JakeSkinner

@DJB you can update the sharing with the following:

from arcgis.gis._impl._content_manager import SharingLevel

sharing_mgr = fs.sharing
if shrOrg:
    sharing_mgr.sharing_level = SharingLevel.ORG
if shrEveryone:
    sharing_mgr.sharing_level = SharingLevel.EVERYONE
if shrGroups:
    for groupID in shrGroups:
        group = gis.groups.get(groupID)
        item_grp_sharing_mgr = sharing_mgr.groups
        item_grp_sharing_mgr.add(group=group)

I did notice if the sharing is already set on the feature service, you can omit this entirely and it will be maintained. I can't recall if it use to do this or not at earlier versions of the API.

DJB

@JakeSkinner

Thanks for the assistance Jake. I wasn't aware that when overwriting a feature service it will still honour the original sharing properties.

I will definitely use this new code for when I need to alter sharing properties in the future.

Thanks again for your help Jake. Cheers!

cjenkins_rva

Hi @JakeSkinner, thanks very much for sharing this. Unfortunately, when I run the script, my symbology and pop-up configurations (both having been defined in the Visualization tab) are not preserved. I believe that's happening because that info is stored at the portal item level, not at the service level, so they aren't captured in existingDef (they would have be to grabbed via fsItem.get_data()). But in your video, I see these properties are preserved. I can't figure how that's possible. What am I missing?

KristalWalsh

Hi @JakeSkinner thank you for this! I am not a programmer but I tried this and am getting what seems to be a sign-in to portal error. Do you know if anyone else has had this problem? I know I'm using the correct user name and password. I am using AGOL not Enterprise so this should be pretty straightforward I think. Thank you, Kristal

JakeSkinner

@KristalWalsh do you know if you are using a built-in AGOL account? Or, are you using a SAML user account? With SAML, there is an icon you can click that will sign you in using the same account you typically sign into Windows with.

KristalWalsh

@JakeSkinner hi, thank you, I have an organizational account for a government agency so not sure if that is considered "built-in". I am signed in to my AGO account in another window not that it makes any difference.

JakeSkinner

@KristalWalsh is there an '@' symbol in your username?

KristalWalsh

@JakeSkinner no, not in the body of the code where my user name is inserted. I followed your video exactly.

KristalWalsh

@JakeSkinner I noticed earlier that I was not signed in to Pro. I thought maybe I got disconnected at some point, so I just ran it again after signing in to Pro. It seems that when I execute the script, it signs me out of Pro. Should that happen?

JakeSkinner

@cjenkins_rva I'm not sure if something changed in the API or not, but I swore this was working before. However, I updated the code to use the .get_data() and apply this to the service using the requests module. I couldn't find a way via the API to apply the properties all at once for all layers; that functionality may not exist, yet. Anyways, give the updated code a try.

ModernElectric

@JakeSkinner

Been using the latest script to rebuild my update workflow.

On one of my Web Maps/Hosted Feature Layers - using this updated script - why am I getting:

mp = prj.listMaps(map)(0)

IndexError: list index out of range

JakeSkinner

@ModernElectric do you have the name of the map in ArcGIS Pro specified correctly for the map variable?

ModernElectric

Disregard.

Please forgive my ignorance, lack of proof-reading abilities 😉

Updated Script is working perfectly for updating our AGOL dataset.

cog_GIS_Admin

This script seems to be just what I am looking for, but I get an error when trying to login to AGOL.

Connecting to AGOL
Traceback (most recent call last):
File "E:\Scripts\Workorders_CD\NewOverwriteWebLayers.py", line 30, in <module>
arcpy.SignInToPortal(portal, user, password)
File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\__init__.py", line 2609, in SignInToPortal
return _SignInToPortal(*args, **kwargs)
ValueError: Error signing on to https://arcgis.com/.

Message : s
Details : Unable to generate token.

Any Thoughts?

cog_GIS_Admin

My post keeps getting marked as spam, not sure why. I'll try again. This script is just what I was looking for, but I am getting an error trying to log into AGOL.

Connecting to AGOL
Traceback (most recent call last):
File "E:\Scripts\Workorders_CD\NewOverwriteWebLayers.py", line 30, in <module>
arcpy.SignInToPortal(portal, user, password)
File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\__init__.py", line 2609, in SignInToPortal
return _SignInToPortal(*args, **kwargs)
ValueError: Error signing on to https://arcgis.com/.

Message : s
Details : Unable to generate token.

Any ideas?

JakeSkinner

@cog_GIS_Admin check the casing of your username, this is case sensitive. For example, if your AGOL login is cog_GIS_Admin, and you specify cog_gis_admin, it will not authenticate.....even though cog_gis_admin will work in a web browser.

cog_GIS_Admin

Thanks Jake, that was the issue. Now working on getting it to auto run with the server task scheduler.

JakeSkinner

@cog_GIS_Admin here is helpful document on how use Windows Task Scheduler with python scripts:

https://community.esri.com/t5/python-documents/schedule-a-python-script-using-windows-task/ta-p/915861

tomshewring

I am running this script with an internal Enterprise (Portal) with IWA.

The script is working for me up until 'Update service with previous properties'

Traceback (most recent call last):
File "<string>", line 81, in <module>
File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\Lib\json\__init__.py", line 346, in loads
return _default_decoder.decode(s)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\Lib\json\decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\Lib\json\decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

JakeSkinner

@TomShewring are you attempting to update a hosted feature service, or a referenced service?

tomshewring

Hi @JakeSkinner , a hosted feature service.
I have got the 'Update service with previous properties' working - I had to use the siteadmin (default Administrator) account when connecting to Enterprise (Portal).
I now have a error in the 'Clearing scratch directory' section. I do not have ArcGISPro open (I am running this script from the command line not from within ArcGISPro) - so I do not know what application could be locking the WebUpdate.sd?
Traceback (most recent call last):
File "E:\AGOL_Scripts\Geoprocessing\ScheduledTools\NHLEonPortal\updateNHLEonPortal2.py", line 102, in <module>
arcpy.Delete_management(file)
File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\management.py", line 7665, in Delete
raise e
File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\management.py", line 7662, in Delete
retval = convertArcObjectToPythonObject(gp.Delete_management(*gp_fixargs((in_data, data_type), True)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\geoprocessing\_base.py", line 512, in <lambda>
return lambda *args: val(*gp_fixargs(args, True))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
arcgisscripting.ExecuteError: ERROR 000601: Cannot delete C:\Users\tshewring\AppData\Local\Temp\scratch\WebUpdate.sd. May be locked by another application.
Failed to execute (Delete).

JakeSkinner

@TomShewring I've seen this error occur sporadically in some implementations (mine included), and I'm unable to find a cause. To workaround the issue, I recommend moving the Clear scratch directory section to the beginning of the script. For example, move this section of code above the section that connects to AGOL/Portal.

tomshewring

@JakeSkinner , thanks - moving the 'Clear scratch directory' section to the beginning of the script, above the section that connects to AGOL/Portal - this works.
One further thing I don't understand is - I have to use the <portalurl>:7443/arcgis address. If I use the WebAdaptor address I get errors such as these (even though I am using the same username and password in each scenario) -
Traceback (most recent call last):
File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\auth\_auth\_winauth.py", line 75, in __init__
creds = gssapi.raw.acquire_cred_with_password(
File "gssapi\raw\ext_password.pyx", line 75, in gssapi.raw.ext_password.acquire_cred_with_password
gssapi.raw.exceptions.BadNameError: Major (131072): An invalid name was supplied, Minor (2529639136): Configuration file does not specify default realm

File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\auth\_auth\_winauth.py", line 84, in __init__
raise Exception("Please ensure gssapi is installed")
Exception: Please ensure gssapi is installed

Do you know why this is?

JakeSkinner

@TomShewring

Do you have Windows Authentication enabled on Portal's web adaptor?
What version of Enterprise?
What version of the arcgis api for python?

tomshewring

@JakeSkinner
1. Yes Windows Authentication is enabled on Portal WebAdaptor
2. Enterprise (Portal / Federated Server / Datastore) version 11.3
3. I have tried the script with

(i) ArcGISPro 3.3.1 -

and

(ii) ArcGISPro 3.1.4

JakeSkinner

@TomShewring try removing the username/password variables from the following lines:

These should not be needed if you Windows Authentication is enabled. It will use the window's account that's signed into the server.

tomshewring

Hi @JakeSkinner , changing to these settings (and using the Portal WebAdaptor address) -
when I run the script from the command line I get a security challenge

So I could not run this as a scheduled task on the Windows server

Doe mee aan het gesprek

Aangemelde leden kunnen berichten plaatsen, updates volgen en meer. Nieuw hier? Registreer een gratis account.

Snelle links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.