nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Add 2k+ pdf's to specific folder in my content

Lake_Worth_BeachAdmin

I need a method to upload roughly 2,000 PDF's into a specific folder in my content (and share to public)

All PDF's will be inside the same directory on a network drive.

I assume python can handle this but not sure, I see I can upload a geodata (shapefile, layer, map etc.) but not positive about images/PDF's.

Encuentra más publicaciones etiquetadas con

Accepted answers

Lake_Worth_BeachAdmin

I was able to do this utilizing the Python API, the code is below for anyone else who may need this in the future

import arcgis
from arcgis.gis import *
import os
import glob
import time
gis = GIS(None, "username", "password")
contentManager = arcgis.gis.ContentManager(gis)
contentManager.create_folder('Folder Name',None)
pdf_list = glob.glob(r'C:\path\to\folder\*.pdf')
additem = arcgis.gis.ContentManager(gis)

for pdf in pdf_list:
    file_name = os.path.basename(pdf)
    pdf_properties = {'type':'PDF','title':file_name.split(".")[0],'tags':'pdf, arcgis,', 'access':'Public'}
    additem.add(pdf_properties,pdf,folder='Historic PDFs')
    time.sleep(1)

item_search = gis.content.search(query='', item_type='PDF')
item_search

for item in item_search:
    item.share(everyone=True)
    time.sleep(1)

I had to use the

time.sleep(1)

otherwise updating the share properties would skip some of the files, I am guessing the calls were being sent to fast for the server to pick up.

All comments

JonathanQuinn

The easiest way to upload files is the requests module:

Post a multi-part encoded file

It's far easier than the urllib2 modules:

Make an http POST request to upload a file using python urllib/urllib2 - Stack Overflow

What I typically do is run through the operation through your browser first and monitor the network traffic. After that, recreate the request in Python.

Something like this would likely work:

addItemURL <SPAN class="operator token">=</SPAN> <SPAN class="string token"><SPAN>'</SPAN><A class="jive-link-external-small" href="https://community.esri.com/external-link.jspa?url=https%3A%2F%2F" target="_blank">https://</A><SPAN><portal>.<domain>.com/portal/sharing/rest/content/users/<user>/addItem'</SPAN></SPAN>
item <SPAN class="operator token">=</SPAN> <SPAN class="string token">'<path to item>'</SPAN>
uploadFile <SPAN class="operator token">=</SPAN> open<SPAN class="punctuation token">(</SPAN>item<SPAN class="punctuation token">,</SPAN><SPAN class="string token">"rb"</SPAN><SPAN class="punctuation token">)</SPAN>
theFile <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">{</SPAN><SPAN class="string token">'file'</SPAN><SPAN class="punctuation token">:</SPAN>uploadFile<SPAN class="punctuation token">}</SPAN>
data <SPAN class="operator token">=</SPAN> dict<SPAN class="punctuation token">(</SPAN>token<SPAN class="operator token">=</SPAN><SPAN class="operator token"><</SPAN>token<SPAN class="operator token">></SPAN><SPAN class="punctuation token">,</SPAN>type<SPAN class="operator token">=</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="comment token">#not sure about what parameters are used for uploading a PDF. My suggestion above will come in handy here)</SPAN>
r <SPAN class="operator token">=</SPAN> requests<SPAN class="punctuation token">.</SPAN>post<SPAN class="punctuation token">(</SPAN>addItemURL<SPAN class="punctuation token">,</SPAN> params<SPAN class="operator token">=</SPAN>data<SPAN class="punctuation token">,</SPAN> files<SPAN class="operator token">=</SPAN>theFile<SPAN class="punctuation token">,</SPAN> verify<SPAN class="operator token">=</SPAN><SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>‍‍‍‍‍‍‍‍‍‍‍‍ <SPAN class="comment token">#verify=False ignores certificate errors</SPAN>
addItemResponse <SPAN class="operator token">=</SPAN> json<SPAN class="punctuation token">.</SPAN>loads<SPAN class="punctuation token">(</SPAN>r<SPAN class="punctuation token">.</SPAN>text<SPAN class="punctuation token">)</SPAN>
<SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN>addItemResponse<SPAN class="punctuation token">)</SPAN>‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

Once you upload an individual item, just loop through your directory using os.walk or os.listdir.

15.1. os — Miscellaneous operating system interfaces — Python 2.7.15 documentation

Lake_Worth_BeachAdmin

I was able to do this utilizing the Python API, the code is below for anyone else who may need this in the future

import arcgis
from arcgis.gis import *
import os
import glob
import time
gis = GIS(None, "username", "password")
contentManager = arcgis.gis.ContentManager(gis)
contentManager.create_folder('Folder Name',None)
pdf_list = glob.glob(r'C:\path\to\folder\*.pdf')
additem = arcgis.gis.ContentManager(gis)

for pdf in pdf_list:
    file_name = os.path.basename(pdf)
    pdf_properties = {'type':'PDF','title':file_name.split(".")[0],'tags':'pdf, arcgis,', 'access':'Public'}
    additem.add(pdf_properties,pdf,folder='Historic PDFs')
    time.sleep(1)

item_search = gis.content.search(query='', item_type='PDF')
item_search

for item in item_search:
    item.share(everyone=True)
    time.sleep(1)

I had to use the

time.sleep(1)

otherwise updating the share properties would skip some of the files, I am guessing the calls were being sent to fast for the server to pick up.

RyanHefley

This appears to be just for AGO, do you know how I could modify the gis=GIS() connector string for ArcGIS Enterprise Portal?

JoshuaBixby

See arcgis.gis module - GIS — arcgis 1.5.0 documentation:

Argument Description
url Optional string. If URL is None, then the URL will be ArcGIS Online. This should be a web address to either a local Portal or to ArcGIS Online in the form: <scheme>://<fully_qualified_domain_name>/<web_adaptor> (Portal Example)https://gis.example.com/portal

ErnestoCarreras2

Very useful information… I am trying to do the same but instead of uploading, I am trying to update the PDF files that are inside a specific folder. Can someone point me to the right direction?

inolaroch

Hi @Lake_Worth_BeachAdmin,

I want to publish 30 pdfs to Arcgis Online, I use the same code but i want to modifiy the propreties like this :

Name of one of my pdfs : Map_community_A3_TEST_61001

Template : ([DOCUMENT_TYPE]_[OBJECT]_[FORMAT]_[NAME]_[CODE])

I want to modifiy pdf_propreties from

pdf_propreties = {'type':'PDF', 'description':'PDF upload for map viewer','title':pdf_name, 'tags':'OPENDATA', 'access':'Public'}

To :

pdf_propreties = {'type':'PDF', 'description':'DOCUMENT_TYPE, FORMAT, NAME','title':NAME, 'tags':'DOCUMENT_TYPE, FORMAT, NAME, CODE', 'access':'Public'}

Do u think there's a way to do it ?

Thank you 🙂

BruceBacia1

Thanks for posting - this will be helpful!

Únete a la Conversación

Los miembros registrados pueden publicar, seguir actualizaciones y más. ¿Nuevo aquí? Regístrate gratis.

Enlaces Rápidos

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.