topic Re: Using pandas in ArcGIS pro in ArcGIS Pro Questions

Using pandas in ArcGIS pro

YasunariMorita — Mon, 23 Oct 2017 08:14:51 GMT

I try to deal with table data by using pandas from ArcGIS pro.

But, I have mysterious error below.

Runtime error
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\__init__.py", line 25, in <module>
from pandas import hashtable, tslib, lib
File "pandas\tslib.pyx", line 5421, in init pandas.tslib (pandas\tslib.c:114996)
File "pandas\tslib.pyx", line 5338, in pandas.tslib.TimeRE.__init__ (pandas\tslib.c:85126)
File "pandas\tslib.pyx", line 5219, in pandas.tslib.LocaleTime.__init__ (pandas\tslib.c:82425)
File "pandas\tslib.pyx", line 5239, in pandas.tslib.LocaleTime.__calc_weekday (pandas\tslib.c:82859)
File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\calendar.py", line 79, in __getitem__
return funcs(self.format)
ValueError: embedded null byte

"null byte" probably means that some paths or file names include \0,but where?

And, this error happens only in case of python3.

any advice would be helpful.
Thanks in advance!

Re: Using pandas in ArcGIS pro

DanPatterson_Retired — Mon, 23 Oct 2017 09:49:28 GMT

What is the nature of the table? (type, field names, data types etc)

How are you accessing Pandas? (Pro script window, another IDE etc, a tool from within arctoolbox in Pro?)

can you convert/load the table within Pro without issue?

Any other useful details.

Re: Using pandas in ArcGIS pro

YasunariMorita — Mon, 23 Oct 2017 10:26:45 GMT

Thanks

From Pro script window, I typed "import pandas as pd",then occurred the error.

I checked "import pandas as pd" in many way.

I try test.py script below.(execute command:propy.dat test.py)

import arcpy
import pandas as pd

ERROR

BUT,

import pandas as pd
import arcpy

SUCCESS!

Why import pandas after import arcpy???

Re: Using pandas in ArcGIS pro

DanPatterson_Retired — Mon, 23 Oct 2017 10:30:41 GMT

I suspect it might have something to do with the newer 'arcgis' module which uses pandas as a shell for the SpatialDataFrame. If you examine the menu tree in windows, pandas is indeed installed. Hence the reason I was asking where you are running python from. When using Pro, you should be using python and everything from the required anaconda package distribution.

Re: Using pandas in ArcGIS pro

ShaunWalbridge — Sun, 12 Dec 2021 07:46:39 GMT

Hello Yasunari,

Could you share what version of ArcGIS Pro you're using, and what version of Windows? Could you also run this from the Python prompt in Pro:

import locale, time
local.setlocale(local.LC_ALL, 'ja')
time.strftime('%a')‍‍‍

Does that produce the same error?

Thanks,

Shaun

Re: Using pandas in ArcGIS pro

YasunariMorita — Wed, 25 Oct 2017 02:39:01 GMT

Hi,Shaun,

version of ArcGIS Pro:1.4.1

version of Windows:windows 7 professional SP1 (64bit)

I ran your code, and it porduced the same error!

import locale, time
locale.setlocale(locale.LC_ALL, 'ja')
'ja'
time.strftime('%a')
Runtime error
Traceback (most recent call last):
File "<string>", line 1, in <module>
ValueError: embedded null byte

I wish this was helpful for you.

Re: Using pandas in ArcGIS pro

ShaunWalbridge — Wed, 25 Oct 2017 05:10:25 GMT

Ah yes, thanks. Yes, this is a problem with the Windows C Runtime (UCRT) that is shipped with ArcGIS Pro 1.4 and earlier. We've fixed the problem in ArcGIS Pro 2.0, if you can upgrade.

Cheers, Shaun