topic Re: Help Cloning Items Using Jupyter Notebook in ArcGIS Enterprise Portal Questions

Help Cloning Items Using Jupyter Notebook

DaveK — Wed, 09 Jun 2021 14:52:20 GMT

Hello!

I'm trying to clone items from our AGO to our organizations enterprise Portal and vice versa. When connecting to my AGO account through the notebook it seems to work just fine. It alerts me that I am logged in as an administrator. When connecting to my Portal account it throws a number of errors including a connection error. Do I need to be an administrator to complete the cloning? Is there any issue with our portal being behind a firewall? and lastly, is an advanced license of Notebook server required for this? Are any of the ArcPy modules required for the cloning process? We currently only have a standard server license. Any help on this topic is appreciated.

Thanks.

Re: Help Cloning Items Using Jupyter Notebook

ReeseFacendini — Wed, 09 Jun 2021 16:51:56 GMT

Clone items is done through the Python API and does not use arcpy modules, so no you don't need to have an advanced license to run it. You don't need to be an administrator for either system, but it often helps cut down on permission issues that can come up. When attempting to connect to your Enterprise Portal, are you doing that from Notebooks in ArcGIS Online? If so, is your Enterprise Portal public facing?

Re: Help Cloning Items Using Jupyter Notebook

DaveK — Wed, 09 Jun 2021 17:01:19 GMT

Hey @ReeseFacendini,

Good to know we don't need an advanced license. I am using the notebooks within ArcGIS Online. Our Portal is not public facing.

Re: Help Cloning Items Using Jupyter Notebook

ReeseFacendini — Wed, 09 Jun 2021 17:13:28 GMT

If your Portal is not public facing, then using Notebooks in ArcGIS Online won't work. ArcGIS Online has no way to find your Portal behind a firewall. With that being said, you can use Jupyter Notebooks from ArcGIS Pro on a machine within your network that can access your Portal and ArcGIS Online. All the functions will be the same from the Notebooks in AGOL and Pro, and this would solve the connection errors you are seeing.

Re: Help Cloning Items Using Jupyter Notebook

DaveK — Mon, 21 Jun 2021 15:35:02 GMT

Hey @ReeseFacendini ,

Thanks for the info! I'm using notebooks within ArcPro on a machine within our network. After trying to connect to our Portal, I receive this message.

I'm on step 2 of this guide - https://support.esri.com/en/technical-article/000022252

I've entered my portal URL and my username and password.

Is there something different I should be doing or does something need to happen on the Portal end to enable access?

Thanks.

Re: Help Cloning Items Using Jupyter Notebook

ReeseFacendini — Mon, 21 Jun 2021 15:50:13 GMT

Hi @DaveK, yes there is one parameter you need to add to that connection string. Add the verify_cert=False piece to the end of the GIS line (see below). This will tell the Python API to not try and validate the SSL certificate.

cnx = GIS(url=portalURL, username=portalUser, password=portalPass, verify_cert=False)

Re: Help Cloning Items Using Jupyter Notebook

DaveK — Mon, 21 Jun 2021 18:04:16 GMT

Hi @ReeseFacendini ,

That worked. I ran the final steps of the process and it came back with this message:

I also don't see any new content in my AGO account (I'm moving items from our Portal to AGO)

Re: Help Cloning Items Using Jupyter Notebook

ReeseFacendini — Mon, 21 Jun 2021 18:09:22 GMT

I think you are passing a full list, where clone_items wants a single object. I suggest iterating through your list of items to be copied and calling clone_items for each iteration

Re: Help Cloning Items Using Jupyter Notebook

DaveK — Thu, 01 Jul 2021 12:29:59 GMT

Hey @ReeseFacendini,

I believe I'm passing a single item into the script with just the item ID. If I still need to iterate through my items, how would I do so?

Thanks.

Re: Help Cloning Items Using Jupyter Notebook

ReeseFacendini — Thu, 01 Jul 2021 14:11:13 GMT

The line where you are calling clone_items within the try / except block, you are passing a list (even though it only has a single item in it). Change the line to read "gis2.content.clone_items(item, copy_data=True, search_existing_items=True)

Re: Help Cloning Items Using Jupyter Notebook

DaveK — Thu, 01 Jul 2021 14:18:41 GMT

That didn't seem to work as it threw the same results as before. Anything else I could be doing wrong?

Re: Help Cloning Items Using Jupyter Notebook

DaveK — Tue, 06 Jul 2021 13:57:16 GMT

Good morning @ReeseFacendini,

After some more research and playing around with Python scripts, I've come across one that worked for me. Here is the script:

source = GIS("PORTAL URL", "PORTAL USERNAME", "PASSWORD", verify_cert=False) target = GIS("https://arcgis.com", "AGO USERNAME") #list all items in user account sourceuser = "PORTAL USERNAME" user = source.users.get(sourceuser) items = user.items() print("--> Root") for item in items: print("\t{} : {} : {}".format(item.title, item.type, item.id)) folders = user.folders for fld in folders: flditems = user.items(fld['title']) print("--> " + fld['title']) for item in flditems: print("\t{} : {} : {}".format(item.title, item.type, item.id)) #set item as variable CloneItem = source.content.get("ITEM ID") CloneItem #clone the item cloned_items = target.content.clone_items(items=[CloneItem]) for ci in cloned_items: display(ci)

I appreciate all your help with this!

Thanks.