topic Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS in Python Questions

MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

JessicaFraver1 — Thu, 24 Dec 2015 00:15:12 GMT

Hi,

Since upgrading ArcGIS Desktop from 10.2.2 to 10.3.1, we receive a new error in our python scripts that use MakeTableView - arcpy.MakeTableView_management(sourcewrkspc + sourcedata, "in_memory\\" + layer, whereclause).

The script error is as follows:

ERROR 000358: Invalid expression

Failed to execute (MakeTableView).

Further tests revealed that the arcpy.MakeTableView does not work on tables with no OBJECTID. Registering the table with the database generates an OBJECTID and gets rid of the error, but this is not an option for some of our tables.

Has anyone experienced this problem with 10.3.1 and know why this error happens? Is there a fix besides creating a workaround to add an OBJECTID?

Thank you!

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

DanPatterson_Retired — Thu, 24 Dec 2015 01:19:11 GMT

Nothing indicated here Make Table View—Help | ArcGIS for Desktop

But the procedure is described here and MakeTableView is the route to do so... Fundamentals of ObjectID fields—Help | ArcGIS for Desktop and be sure to check the sublinks.

Did you try it somewhere else than in-memory? or perhaps without a whereclause to narrow down whether it is for some inputs, all, or a combination?

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

AlisonGaiser1 — Tue, 19 Jan 2016 19:10:50 GMT

Jessica,

We are experiencing the same issue here. We also cannot add an OBJECTID to the table we are accessing.

Did you find any other fixes or workarounds?

Thanks,

Alison

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

JessicaFraver1 — Tue, 19 Jan 2016 21:55:50 GMT

Hi Alison,

Unfortunately, we still don't understand what happened to make either the tables/views without an object ID, or the MakeTableVIew tool, behave differently with 10.3.1. We ended up adding a step in the script to search for the ObjectID field. If there is an ObjectID proceed with MakeTableView, if no ObjectID, CopyRows to in-memory. The remainder of the script is the same. This in not ideal for several reasons, but it works for us for now.

In response to Dan's reply:

"Did you try it somewhere else than in-memory? or perhaps without a whereclause to narrow down whether it is for some inputs, all, or a combination?"

We tried modifying output location and whereclause in different combinations, but nothing worked.

If you find another workaround, or potential cause of this error, can you please post it? I will do the same.

Thank you,

Jessica

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

Kathleen_Crombez — Fri, 29 Jan 2016 21:01:06 GMT

I have run into the same error using the arcpy.MakeTableView_management function on a feature class that HAS and OBJECTID field.

I am also using a where clause in the function.

The script runs perfectly in 10.2 but fails on this function in 10.3

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

JoshuaBixby — Sat, 30 Jan 2016 02:32:22 GMT

Can you provide an example of a where clause that fails?

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

Kathleen_Crombez — Thu, 11 Feb 2016 22:48:01 GMT

Joshua Bixby,

It is strange, because I have other MakeTableView statements with a where clause that run before this one and they all run fine.

This is the line that throws the error in 10.3

Here is the error

Here are the field properties of the Summary_CondoPin table

One thing I did notice about the Summary_CondoPin table is the where clause returns zero records. So maybe that has something to do with the error.

But as I mentioned before, this line runs fine without error in 10.2

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

JoshuaBixby — Fri, 10 Dec 2021 22:37:37 GMT

A few questions:

Everything between 10.2.x and 10.3.x is the same?
- Background processing enabled/disabled for both?
- 64-bit Geoprocessing installed/not for both?
- If connecting to SDE, same DMBS drivers installed for both?
What is the backend storage for the Summary_CondoPin table?
What does ArcPy.AddFieldDelimiter return for field delimiters?

Although using AddFieldDelimiter feels anal retentive at times, it is the most robust way of building expressions so they are transferrable across multiple data stores. Does using the following work?

arcpy.MakeTableView_management(
    Summary_CondoPin,
    'Frequency_CondoPin',
    """{} > 1 AND {} IS NULL""".format(arcpy.AddFieldDelimiters(Summary_CondoPin,
                                                                'FREQUENCY'),
                                       arcpy.AddFieldDelimiters(Summary_CondoPin,
                                                                'Comment')))

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

Kathleen_Crombez — Fri, 12 Feb 2016 16:37:56 GMT

The machine running 10.2.2 has Windows Server 2008 R2 Enterprise 64-bit OS. (Virtual)

The python shell launches as Python 2.7.5 (default, May 15 2013, 22:43:36) [MSC v.1500 32 bit (Intel)] on win32

The machine running 10.3.1 has Windows 7 Professional 64-bit OS.

The python shell launches as Python 2.7.8 (default, Jun 30 2014, 16:03:49) [MSC v.1500 32 bit (Intel)] on win32

I'm not certain how to test for background processing. Both machine were set up with the standard install.

The script was written on the Windows 7 machine before upgrading from 10.2.2 to 10.3.1

The Summary_CondoPin table is in a file geodatabase located on a Windows Server 2012 R2 Standard 64-bit OS.

print """{} > 1 AND {} IS NULL""".format(arcpy.AddFieldDelimiters(Summary_CondoPin, 'FREQUENCY'), arcpy.AddFieldDelimiters(Summary_CondoPin, 'Comment'))

Returned FREQUENCY > 1 AND Comment IS NULL

Using the syntax you provided me for the MakeTableView failed with the same error.

Traceback (most recent call last):

File "X:\ParcelFeaturesQC\ParcelFeaturesQC.py", line 676, in <module>

startArcSDE(True)

File "X:\ParcelFeaturesQC\ParcelFeaturesQC.py", line 619, in startArcSDE

QC.runCondoPinCheck()

File "X:\ParcelFeaturesQC\ParcelFeaturesQC.py", line 519, in runCondoPinCheck

arcpy.MakeTableView_management(Summary_CondoPin,'Frequency_CondoPin', """{} > 1 AND {} IS NULL""".format(arcpy.AddFieldDelimiters(Summary_CondoPin, 'FREQUENCY'), arcpy.AddFieldDelimiters(Summary_CondoPin, 'Comment')))

File "C:\Program Files (x86)\ArcGIS\Desktop10.3\ArcPy\arcpy\management.py", line 7047, in MakeTableView

raise e

ExecuteError: ERROR 000358: Invalid expression

Failed to execute (MakeTableView).

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

JoshuaBixby — Fri, 12 Feb 2016 18:11:04 GMT

I tested some variations of your situation in 10.3.1 using file geodatabases, and I don't run into that error. At this point, all I can suggest is going down the Esri Support incident route.

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

Kathleen_Crombez — Fri, 12 Feb 2016 19:05:55 GMT

Thanks for taking the time to try to figure it out.

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

AnnStark2 — Thu, 18 Feb 2016 00:10:40 GMT

Just wanted to chime in that we are having the same issue with MakeTableView not working in 10.3.1 environments but the same exact script running just fine in 10.2 environment (we store the scripts on a network drive so it is the same script in each instance that is run). We tried adding the OBJECTID to the table (in this case a SQL View), based on comments in this post, but that did not solve the problem for us.

Our python statement looks like this

arcpy.MakeTableView_management(UTILITY_BILLING_CUSTOMERS, Utility_Billing_Customers_View, "", "", "OBJECTID OBJECTID VISIBLE NONE;...<many fields here>")

in case that's of interest to anyone. No WHERE clause is used.

It sounds like a bug and hopefully will be addressed in 10.4.

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

AlisonGaiser1 — Thu, 18 Feb 2016 13:35:28 GMT

Has anyone logged a call with Esri? If so, anyone have a bug number?

We are up and running by adding in the OBJECTID field in our materialized views so not sure what kind of call we would post to Esri Canada?

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

Kathleen_Crombez — Thu, 24 Mar 2016 21:02:42 GMT

This continues to be an issue for us.

We have several scripts that have been written over the years that we either have set to run on scheduled tasks or we run annually during different times of the year.

Most of these scripts now fail at version 10.3.1 due to this error.

ERROR 000358: Invalid expression

This error is occurring on both the MakeTableView and MakeFeatureLayer methods.

All of our tables and layers have OBJECTID fields.

I really hope that someone from ESRI can track the error down and fix it soon. We have already upgraded all our desktop machines to 10.3.1 and are hoping to upgrade our servers in a couple months. But this issue is going to leave us dead in the water if it isn't fixed.

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

DanPatterson_Retired — Thu, 24 Mar 2016 23:30:42 GMT

If no one has reported it, there will be no error report. If one has been filed, then you could ask your tech support for a contact number.

some links

Error reporting for ArcGIS software—Help | ArcGIS for Desktop

then each version of arcmap contains a document like this, so since you are using an older than current release version, chec to see if the error had been reported and solved. If it isn't on the list, it probably wasn't reported...it is buried in a huge list.. or hasn't been fixed, or it isn't a software error but a user error or procedural difference of opinion. Here it is anyway\

http://downloads.esri.com/support/downloads/other_/104-IssuesAddressedList.pdf

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

Kathleen_Crombez — Thu, 31 Mar 2016 15:19:30 GMT

I found a few bugs had been reported that seemed relevant to this issue.

Both said the issue had been fixed in version 10.4

I just upgraded to 10.4 and am still having this error occur.

These scripts run fine in version 10.2.2

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

Waan — Wed, 25 May 2016 15:05:16 GMT

Hi Kathleen,

Have you found a workaround for this? Did Esri get back to you about a bug report? We are testing an upgrade from 10.1 to 10.3.1 and found a vital script is failing after a MakeTableView (error is actually thrown by a subsequent SelectLayerByAttribute).

Thanks,

-W

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

DanPatterson_Retired — Wed, 25 May 2016 15:10:14 GMT

On my blog near the top, I have links to the change logs performed in arcmap, if you want to wade through and see if one is mentioned that involves maketableview, this would be the shortest path other than filing a bug error yourself. Have a look

The ...py... links

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

Waan — Fri, 10 Dec 2021 22:37:39 GMT

Thanks Dan, I was actually wading through some of them when you replied. While there were some fixes to MakeTableView in 10.3 and 10.4, they seemed to deal with specific issues, e.g. when working on a .csv. I didn't see anything to indicate a broader fix.

I re-opened a ticket with Esri about this issue. For the sake of completeness in this thread, here's my piece of code that bombs ... this is a table and a feature class in a file geodatabase:

wellboretable = workspace + "tbl_wellbores"
wellbores = workspace + "wellbores"
arcpy.MakeTableView_management(wellboretable, "wellboretable_layer")
arcpy.AddJoin_management("wellboretable_layer", "UniqueId", wellbores, "UniqueId", "KEEP_ALL")
arcpy.SelectLayerByAttribute_management("wellboretable_layer", "NEW_SELECTION", "(\"tbl_wellbores.Deviation\" = '' OR \"tbl_wellbores.Deviation\" IS NULL) AND \"wellbores.Length_ft\" >= 3000")

Lest anyone thinks the syntax in the select statement is bad, I used GetCount_management, Exists, ListFields, and CopyRows_management to verify that data existed, the join worked, and the fields were typed accurately. I also tried using single and double quotes instead but still received an error. Interestingly, I noticed GetCount_management would return 0 after a bomb, so I used a CLEAR_SELECTION throughout my testing. To make this even simpler, I tried the following after the join:

arcpy.SelectLayerByAttribute_management("wellboretable_layer", "NEW_SELECTION", "\"tbl_wellbores.OBJECTID\" = 1")

... which still threw the same ERROR 000358. To be sure, I used a SearchCursor to verify that an OBJECTID of 1 exists in this table view. I emphasize that all of this code works fine in 10.1. I didn't spot anything in 10.3 (or 10.3.1) documentation that the SelectByAttribute syntax or SQL syntax had changed.

I'll see what Esri has to say.

Re: MakeTableView in python script fails after Update to 10.3.1 on 64 bit OS

DanPatterson_Retired — Fri, 10 Dec 2021 22:37:42 GMT

put a print statement after this line to ensure that the paths are correct

wellboretable = workspace + "tbl_wellbores"

I am wondering if a \ is missing before tbl_wellbores

One incarnation won't give you the correct path, the second would produce an error and the 3rd would work and the last is an alternative (then there is the join thing

>>> workspace = r"c:\Temp\path"
>>> workspace + "tbl_wellbores"
'c:\\Temp\\pathtbl_wellbores'
>>> workspace = r"c:\Temp\path\"
Traceback (  File "<interactive input>", line 1
    workspace = r"c:\Temp\path\"
                               ^
SyntaxError: EOL while scanning string literal
>>> workspace = r"c:\Temp\path" + "\tbl_wellbores"
>>> workspace
'c:\\Temp\\path\tbl_wellbores'
>>> workspace = "c:/Temp/path" + "/tbl_wellbores"
>>> workspace
'c:/Temp/path/tbl_wellbores'
>>>