topic Re: arcpy.TableToGeodatabase_conversion losing text values in Geoprocessing Questions

arcpy.TableToGeodatabase_conversion losing text values

AndrewL — Thu, 30 Jan 2014 17:50:27 GMT

I am using the arcpy.TableToGeodatabase_conversion to convert a comma-separated .txt file that I download daily to a table in a geodatabase.

arcpy.TableToGeodatabase_conversion("2013daily.txt", "C:/Users/smith/Desktop/test/all_observations.gdb")

One of the fields in the .txt file contains numbers and text. The above code works in my python script if I am just using the python shell on my PC. It works in that in creates a field in the geodatabase that is text. Therefore it keeps all the values.

However, if I run my python script on the ArcGIS Server VM, it just converts the text values into null. It creates an integer field, and all the text values are lost. I am not sure why this happens on the VM. I am using the same set of data. Thank you.

Re: arcpy.TableToGeodatabase_conversion losing text values

MichaelVolz — Thu, 30 Jan 2014 18:13:42 GMT

Could you be running the script in a 32-bit environment on your PC and in a 64-bit environment on your VM server?

Re: arcpy.TableToGeodatabase_conversion losing text values

AndrewL — Thu, 30 Jan 2014 18:16:52 GMT

Hello.

No they are both running 64-bit. Thanks.

Re: arcpy.TableToGeodatabase_conversion losing text values

MichaelVolz — Thu, 30 Jan 2014 18:20:50 GMT

Are you running your scripts through IDLE?

Re: arcpy.TableToGeodatabase_conversion losing text values

AndrewL — Thu, 30 Jan 2014 18:23:08 GMT

No in the windows command prompt. I call the loader.bat file which calls the .ini config file and .py file. Thanks!

Re: arcpy.TableToGeodatabase_conversion losing text values

MichaelVolz — Thu, 30 Jan 2014 18:33:05 GMT

Do you have any error logging included in your python script that could help to identify the problem?

Re: arcpy.TableToGeodatabase_conversion losing text values

AndrewL — Thu, 30 Jan 2014 18:39:04 GMT

There is some error logging. I did not create this script from scratch. I'm doing some modification of an older script my company uses. I am not getting an error. It runs fine.

Re: arcpy.TableToGeodatabase_conversion losing text values

MichaelVolz — Thu, 30 Jan 2014 19:00:29 GMT

Would you be able to send the data and script in a post so I can try it on both a desktop and server?

Re: arcpy.TableToGeodatabase_conversion losing text values

AndrewL — Sun, 12 Dec 2021 02:00:45 GMT

Hello. I can try. Most of the script was written by a private vendor, so I am not sure if I feel comfortable with that. I will try to work up something though.

Also, a schema.ini file is created when running the script on the VM, and not on my PC. It's contents is here. Col 1 and 2 only contain integers. Columns 3,5,7,11,13,15, 17 all have a mix of text and integer values, but only the integer values come through on my VM. Thank you.

[201312daily.txt]
Col3=Tmax Text
Col5=Tmin Text
Col7=Tavg Text
Col11=DewPoint Text
Col13=WetBulb Text
Col15=Heat Text
Col17=Cool Text

Re: arcpy.TableToGeodatabase_conversion losing text values

AndrewL — Fri, 31 Jan 2014 12:21:20 GMT

Hi I have attached the python script and the data file (zip). Thank you for your help! Basically the script extracts the files from the zip file then looks for the .txt file that contains "daily" in the file name, and converts that to geodb table.

Re: arcpy.TableToGeodatabase_conversion losing text values

MichaelVolz — Fri, 31 Jan 2014 13:02:37 GMT

Andrew:

I changed some paths for my specific environment and ran your script successfully. What field is not getting populated correctly?

Re: arcpy.TableToGeodatabase_conversion losing text values

AndrewL — Fri, 31 Jan 2014 14:17:56 GMT

The SnowFall and PrecipTotal fields.

Those fields contain text values 'M' and ' T', but they are lost once I do the tabletogeodb conversion. If I run the script on my VM and look at the geodatabase table, those are now number fields and the values of M and T are now replaced with blank space.

Thanks!

Re: arcpy.TableToGeodatabase_conversion losing text values

MichaelVolz — Fri, 31 Jan 2014 14:26:48 GMT

I have just run your script on a desktop machine with v10.2. The fields SnowFall and PrecipTotal are being created as Data Type Double and there are blank values, 0 values, and other miscellaneous values from 0.1 to 14.5. Do those values sound correct from the data you let me test with?

Re: arcpy.TableToGeodatabase_conversion losing text values

AndrewL — Fri, 31 Jan 2014 14:37:59 GMT

Yes that is correct. That is what is happening on my VM. I am running the scipt on my PC using v10.1, and it does not produce blank values.

Re: arcpy.TableToGeodatabase_conversion losing text values

MichaelVolz — Fri, 31 Jan 2014 14:55:05 GMT

I ran the script on a desktop v10.0 machine and got the same results of blank values, 0 values, and other miscellaneous values from 0.1 to 14.5. There must be some configuration setting on your desktop that is different from all the other machines, at least that's what I'm thinking.