Community
Select to view content in your preferred language

Publishing CSV in ArcGIS Online with publish_parameters fails

35
0
4 hours ago
Labels (1)
Labels
JACooper
by
Regular Contributor
4 hours ago

I recently switched my workflow from using `gis.content.add()` to `Folder.add()`, as the future warnings have been advising. I have one workflow that publishes a non-spatial CSV to a hosted table to ArcGIS Online that I believe was working as recently as last week with the new `arcgis==2.4.2` version. This week, however, trying to publish with any non-null `publish_parameters` argument at all is resulting in a hallucination of the item already existing in the organization. I have tested with various datasets and item names (including item names never before used for the organization), and all have come back with this exception. Any publish parameter will trigger this for me (time zone, type, location type). Publishing without the argument or with a blank dictionary does not trigger this issue, but it will geocode any location fields and cost me credits, which is the point of setting `{"locationType": "none"}` for tables.

Here's a stripped down version that trigger the error for me. Just enter your own credentials, ensure you have arcgis==2.4.2 installed, and execute. My error messages are at the bottom of the code block, environment specs after that. Let me know if I've missed anything. Thanks, all!

import os, sys, arcgis, pandas as pd, time

df = pd.DataFrame({"state": ["Wyoming"]})
downloads = os.path.join(os.path.expanduser("~"), "Downloads")
tstcsvname = "test_csv"
tst_path = os.path.join(downloads, f"{tstcsvname}.csv")
df.to_csv(tst_path, index=False)

# Enter your own username and password here:
uname =
pwrd =
gis = arcgis.GIS(url="https://www.arcgis.com", username=uname, password=pwrd)

# Get the folder
user = gis.users.me
target_folder = [f for f in user.folders if f.properties["id"] == "Root Folder"][0]

counter = 0
for pp in [None, {"locationType": "none"}]:
    # Check to make sure the CSV/Feature layer isn't there already.
    remote = None
    for itype in ["CSV", "Feature Service"]:
        search = gis.content.search(
            query=f'title: "{tstcsvname}", type: "{itype}"', max_items=1
        )
        if search:
            # If it is, remove it fully for a clean, fresh execution.
            remote = search[0]
            print("Deleting")
            print(remote)
            remote.delete(permanent=True)
    del remote


    # Add test data file
    props = {"title": tstcsvname, "type": "CSV"}
    job = target_folder.add(item_properties=props, file=tst_path)
    remotecsv = job.result()
    # remotecsv = gis.content.add(item_properties=props,file=tst_path)  # This loads a corrupted CSV; not sure what this is about...
    print(remotecsv)

    time.sleep(1.5)

    if not pp:
        # Try 1: Publishing works here
        # WARNING! This will use credits to geocode 1 record
        remotecsv.publish()
        print("Successful publishing without publish_parameters")
        # Woops, that geocoded when I didn't mean for it to. Let's use publish_parameters to avoid that.
    else:
        # Try 2: But if you toggle to this option, it does not.
        print("Try to publish with publish parameters")
        # pp = {"locationType": "none"}
        remotecsv.publish(publish_parameters=pp)
        
        # arcgis==2.4.1.1
        # Traceback (most recent call last):
        #   File "~\Downloads\publish_parameters_error.py", line 21, in <module>
        #     remotecsv.publish(publish_parameters=pp)
        #   File "~\Python311\site-packages\arcgis\gis\__init__.py", line 16825, in publish
        #     return self._publish(**params)
        #            ^^^^^^^^^^^^^^^^^^^^^^^
        #   File "~\Python311\site-packages\arcgis\gis\__init__.py", line 17111, in _publish
        #     raise Exception("Service name already exists in your org.")
        # Exception: Service name already exists in your org.
        
        # arcgis==2.4.2
        # Traceback (most recent call last):
        #   File "~\Downloads\publish_parameters_error.py", line 27, in <module>
        #     remotecsv.publish(publish_parameters=pp)
        #   File "C~\Lib\site-packages\arcgis\gis\__init__.py", line 17877, in publish
        #     return self._publish(**params)
        #            ^^^^^^^^^^^^^^^^^^^^^^^
        #   File "~\Lib\site-packages\arcgis\gis\__init__.py", line 18164, in _publish
        #     raise Exception("Service name already exists in your org.")
        # Exception: Service name already exists in your org.
    print()

System: Windows 11 (2 machines tested)

Python versions tested: 3.11.8, 3.12.4, & 3.12.10

`arcgis` package versions tested: 2.4.1.1 & 2.4.2

`pip freeze`:

annotated-types==0.7.0
arcgis==2.4.2
cachetools==6.2.2
certifi==2025.11.12
cffi==2.0.0
charset-normalizer==3.4.4
click==8.3.1
cloudpickle==3.1.2
colorama==0.4.6
contourpy==1.3.3
cryptography==46.0.3
cycler==0.12.1
dask==2025.2.0
fonttools==4.60.1
fsspec==2025.10.0
geomet==1.1.0
idna==3.11
jaraco.classes==3.4.0
jaraco.context==6.0.1
jaraco.functools==4.3.0
keyring==25.7.0
kiwisolver==1.4.9
locket==1.0.0
lxml==6.0.2
matplotlib==3.10.7
matplotlib-inline==0.2.1
more-itertools==10.8.0
networkx==3.5
numpy==2.3.5
oauthlib==3.3.1
packaging==25.0
pandas==2.3.3
partd==1.4.2
pillow==12.0.0
puremagic==1.30
pyarrow==20.0.0
pycparser==2.23
pydantic==2.12.4
pydantic_core==2.41.5
pylerc==4.0
pyparsing==3.2.5
pyspnego==0.12.0
python-dateutil==2.9.0.post0
pytz==2025.2
pywin32==311
pywin32-ctypes==0.2.3
PyYAML==6.0.3
requests==2.32.5
requests-oauthlib==2.0.0
requests-toolbelt==1.0.0
six==1.17.0
sspilib==0.4.0
toolz==1.1.0
traitlets==5.14.3
truststore==0.10.4
typing-inspection==0.4.2
typing_extensions==4.15.0
tzdata==2025.2
ujson==5.11.0
urllib3==2.5.0
websocket-client==1.9.0

0 Kudos
0 Replies