topic Re: Publish CSV to Enterprise Portal Errors in ArcGIS API for Python Questions

Publish CSV to Enterprise Portal Errors

JaredPilbeam2 — Wed, 10 Mar 2021 17:32:35 GMT

I'm trying to do something simple using the following help doc, but I can not seem to publish.
https://geosaurus.maps.arcgis.com/home/item.html?id=a1db6db172bc49a8932daacc2ed3d3ac#preview

I'm able to add it to the Portal, but I cannot get it to publish.

from IPython.display import display from arcgis.gis import GIS import os gis = GIS('Home') csv_file = r'C:\Users\jpilbeam\Downloads\c19_Vaccine_Current.csv' csv_item = gis.content.add({}, csv_file)#add csv to Portal csv_layer = csv_item.publish(None, file_type='csv')

Error:

--------------------------------------------------------------------------- KeyError Traceback (most recent call last) In [15]: Line 1: csv_layer = csv_item.publish(None, file_type='csv') File C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\gis\__init__.py, in publish: Line 10353: elif not buildInitialCache and ret[0]['type'].lower() == 'image service': KeyError: 'type' ---------------------------------------------------------------------------

Other attempts:

csv_layer = csv_item.publish() Error: KeyError: 'type'

csv_layer = csv_item.publish('csv') Error: ValueError: dictionary update sequence element #0 has length 1; 2 is required

Re: Publish CSV to Enterprise Portal Errors

JakeSkinner — Wed, 10 Mar 2021 17:54:15 GMT

@JaredPilbeam2 try using the publishParameters parameter in the publish call. You'll need this info if you're trying to publish the CSV as a feature service. Ex:

csv_layer = csv_item.publish(publishParameters={"type":"csv","name":"XY_Locations","locationType":"coordinates","latitudeFieldName":"Latitude","longitudeFieldName":"Longtidue"})

The above is publishing a CSV to a feature service called XY_Locations. It's creating the spatial content using coordinates from fields Latitude and Longitude.

Re: Publish CSV to Enterprise Portal Errors

JaredPilbeam2 — Wed, 10 Mar 2021 19:50:41 GMT

Hi Jake,

This resulted in an error:

csv_layer = csv_item.publish(publishParameters={"type":"csv"})

--------------------------------------------------------------------------- TypeError Traceback (most recent call last) In [20]: Line 1: csv_layer = csv_item.publish(publishParameters={"type":"csv"}) TypeError: publish() got an unexpected keyword argument 'publishParameters' ---------------------------------------------------------------------------

I need the csv file published as a table. It doesn't have coordinate fields and it's not intended to be a spatial feature.

Re: Publish CSV to Enterprise Portal Errors

JaredPilbeam2 — Wed, 10 Mar 2021 22:07:30 GMT

I also tried what the help doc does. It has a text field with place name values specified in the address_fields parameter. My CountyName field is also a text field with place names. But, this also errors.

csv_flayer = csv_item.publish(None, {"Address":"CountyName"}) --------------------------------------------------------------------------- KeyError Traceback (most recent call last) In [23]: Line 1: csv_flayer = csv_item.publish(None, {"Address":"CountyName"}) File C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\gis\__init__.py, in publish: Line 10353: elif not buildInitialCache and ret[0]['type'].lower() == 'image service': KeyError: 'type' ---------------------------------------------------------------------------

Re: Publish CSV to Enterprise Portal Errors

MehdiPira1 — Thu, 11 Mar 2021 03:10:35 GMT

@JaredPilbeam2 ,

I just tried to add and publish a CSV (no coordinates and no address ) to AGOL and it worked fine.

I just used the publish method without any input parameters.

csv_layer = csv_item.publish()

I'd recommend trying to add and publish a different CSV file to check if this works for you too.

The other thing to consider is to check the field names and remove if they have any characters such as //\,()[],....

Re: Publish CSV to Enterprise Portal Errors

JaredPilbeam2 — Thu, 11 Mar 2021 15:18:22 GMT

@MehdiPira1

I already tried that, as seen above. No luck. Also, I'm working with Enterprise Portal. I don't have the option to publish to AGOL.

I tried with a blank CSV. It's throwing a KeyError still?

csv_file = r'C:\Users\jpilbeam\test.csv' csv_item = gis.content.add({}, csv_file) ##It adds the CSV with no errors csv_lyr = csv_item.publish() ## throws KeyError: 'type'

Re: Publish CSV to Enterprise Portal Errors

JaredPilbeam2 — Tue, 06 Jul 2021 14:16:52 GMT

@MehdiPira1

@JakeSkinner

I'm used to my Visual Studio 2019 IDE so I brought the code over from the Pro Notebook it was in. And the error was still the same: KeyError: 'type'. Then I was checking the encoding by reading it to file. New error.

Now it's telling me to specify the type.

gis = GIS('url', 'user', 'password') csv_file = r'C:\Users\jpilbeam\Downloads\c19_Vaccine_Current.csv' with open(csv_file, "r") as f: print(f) csv_item = gis.content.add({}, str(f)) ##<--error is pointing here csv_lyr = csv_item.publish() print(csv_lyr)

<_io.TextIOWrapper name='C:\\Users\\jpilbeam\\Downloads\\c19_Vaccine_Current.csv' mode='r' encoding='cp1252'> ##<--1st print statement Traceback (most recent call last): File "\\gisfile\GISstaff\Jared\Python Scripts\ArcGISPro\CSVtoPortal.py", line 11, in <module> csv_item = gis.content.add({}, str(f)) File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\gis\__init__.py", line 4202, in add raise RuntimeError('Specify type in item_properties') RuntimeError: Specify type in item_properties

Re: Publish CSV to Enterprise Portal Errors

MehdiPira1 — Fri, 12 Mar 2021 01:06:13 GMT

@JaredPilbeam2

What version of ArcGIS API for Python are you using?

Perhaps a version upgrade helps!

Re: Publish CSV to Enterprise Portal Errors

JaredPilbeam2 — Fri, 12 Mar 2021 16:16:17 GMT

@MehdiPira1
I'm using version 1.8.3. If there's been an update I'll look for it, thanks.

Re: Publish CSV to Enterprise Portal Errors

JaredPilbeam2 — Fri, 12 Mar 2021 17:48:25 GMT

@MehdiPira1

Ok, I upgraded to 1.8.4. And I tried all the same things again. Same errors.

Tried this:

csv_layer = csv_item.publish(publishParameters={"type":"csv"}) --------------------------------------------------------------------------- TypeError Traceback (most recent call last) In [9]: Line 1: csv_layer = csv_item.publish(publishParameters={"type":"csv"}) TypeError: publish() got an unexpected keyword argument 'publishParameters' ---------------------------------------------------------------------------

csv_layer = csv_item.publish(None, file_type='csv') --------------------------------------------------------------------------- KeyError Traceback (most recent call last) In [11]: Line 1: csv_layer = csv_item.publish(None, file_type='csv') File C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\gis\__init__.py, in publish: Line 10353: elif not buildInitialCache and ret[0]['type'].lower() == 'image service': KeyError: 'type' ---------------------------------------------------------------------------

csv_layer = csv_item.publish() --------------------------------------------------------------------------- KeyError Traceback (most recent call last) In [14]: Line 1: csv_layer = csv_item.publish() File C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\gis\__init__.py, in publish: Line 10353: elif not buildInitialCache and ret[0]['type'].lower() == 'image service': KeyError: 'type' ---------------------------------------------------------------------------

Re: Publish CSV to Enterprise Portal Errors

MehdiPira1 — Mon, 15 Mar 2021 03:42:58 GMT

@JaredPilbeam2 ,

Found the problem. The catch here is specifying none for the location type since there is no coordinates in the csv file and I didn't know publishing a csv in Portal would require some parameters (type and location type) to specify in this case, compared to publishing to AGOL which you can (also) publish without parameters.

params={"type":"csv","locationType":"none"} csv_item.publish(publish_parameters=params)

Make sure you first delete the defective published csv feature layer.

Cheers

Mehdi

Re: Publish CSV to Enterprise Portal Errors

JaredPilbeam2 — Mon, 15 Mar 2021 14:19:03 GMT

@MehdiPira1

Thanks, I was able to publish a blank CSV with those parameters! But, I'm still getting a KeyError with the CSV I actually need published. I've continued the conversation in my other post where I attached the troublesome CSV. Thanks for your help.

Re: Publish CSV to Enterprise Portal Errors

MehdiPira1 — Tue, 16 Mar 2021 00:48:45 GMT

@JaredPilbeam2

Not a problem.

Re: Publish CSV to Enterprise Portal Errors

MarcusAndersson — Sun, 04 Jul 2021 16:38:03 GMT

Hi,

I found this post quite randomly, but just wanted to let you know that the name of the Portal, your Username, and your Password is written in plain text in your post. I would suggest to edit and remove this asap.

BR,
Marcus

Re: Publish CSV to Enterprise Portal Errors

John_Herrera — Mon, 03 Mar 2025 18:40:05 GMT

I've been using this code to upload and publish a csv file with no location to ArcGIS Enterprise (Portal). Works fine, however recently content.add has been deprecated and running the code will throw a warning message. Users are advised to use Folder.add.

I'm unable to locate a sample code or find anything useful researching the ArcGIS API for Python documentation. All examples I've seen so far are for publishing csv with XY locations. Any help you can provide getting me out of this rabbit-hole is greatly appreciated! My code is below

from arcgis.gis import GIS
gis = GIS("home")
csv_file = r"C:\data\Demo_noLocation.csv"
csv_item = gis.content.add({}, csv_file)
display(csv_item)
params={"type":"csv","locationType":"none"}
csv_item.publish(publish_parameters=params)