topic Re: Using Python to make XY Event Layer; get an error but the code continues in ArcGIS API for Python Questions

Using Python to make XY Event Layer; get an error but the code continues

deleted-user-nik7HiqJkbED — Fri, 13 Mar 2020 19:10:02 GMT

Hello,

I am using python 3.6.8 to make an XY Event layer. I first use the arcpy.MakeXYEventLayer_management(inputCSV, "Longitude", "Latitude", TempFeatureLayer, WGS84, "")

where TempFeatureLayer is defined earlier as "XYTemp", and WGS84 is the variable holding the GCS_WGS84 coordinate system info.

I pass this and get an error the first time that is pretty extensive but the end says: "

SystemError: <built-in function isinstance> returned a result with an error set"

I am able to continue running the code successfully inspite of this seeming error. I would like for this to simply not show up as the code will go to someone with little experience and i dont want this to trigger concern.

Interestingly when I run the code again for the next input, this error does not appear again....

Does anyone know of an exception handling i can use to eliminate this?

I am currently running 10.7 desktop and have been working in the jupityer notebooks version that comes with this desktop version.

i have attached the error and the python code i wrote. the section happens at line 277

Thank you for the help

Re: Using Python to make XY Event Layer; get an error but the code continues

Anonymous User — Sun, 12 Dec 2021 08:59:07 GMT

So it looks like the error is coming from numpy, which could be used by other modules (op.py) that you are indirectly using. It is checking if the object's (featureclass in this case maybe?) dataframe is an instance of a numpy array and failing.

You could probably place that in a try/ except and just pass in the block to hide it.

try:
    XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except SystemError:
    pass‍‍‍‍‍

Re: Using Python to make XY Event Layer; get an error but the code continues

deleted-user-nik7HiqJkbED — Fri, 13 Mar 2020 21:46:34 GMT

Thank you so much for the quick response!

One question- do I need to set “SystemError” as a variable by defining it before I write the “except SystemError” command?

I apologize for this newbee question- I am what you might call a “baby pythoner” right now.

Thanks for the help!!

Sophia

Re: Using Python to make XY Event Layer; get an error but the code continues

Anonymous User — Sun, 12 Dec 2021 08:59:10 GMT

No problem-

You don't have to assign it because it is a named built-in exception (others are Exception, RuntimeError, TypeError, etc). You could assign it to a variable and then do stuff with it though like log it, message it, ignore it. Python docs for it are here: Built-in Exceptions — Python 3.8.2 documentation

try:
    XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except SystemError as se:
    print(se)‍‍‍‍‍

Re: Using Python to make XY Event Layer; get an error but the code continues

deleted-user-nik7HiqJkbED — Fri, 13 Mar 2020 22:06:22 GMT

Thank you Mr. Kling.

I tried the following attempts:

SystemError = "SystemError: <built-in function isinstance> returned a result with an error set"

try:

XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except SystemError:

pass

Result: no change- error still raised

try:

XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except SystemError as se:

pass

Result: no change- error still raised

try:

XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except SystemError:

pass

Result: no change- error still raised

Did I perhaps write the expression incorrectly?

Or do you perhaps have any other ideas? I was unsure how to even research this exception. I greatly appreciate the exceptions page you shared and will continue to look down that road but if you have any other insights I would be very appreciative.

Thanks so much!!

Sophia

SOPHIA THOMPSON

gis coordinator

o 505.924.3803

e ssthompson@cabq.gov<mailto:ssthompson@cabq.gov>

cabq.gov/planning<https://www.cabq.gov/planning>

Re: Using Python to make XY Event Layer; get an error but the code continues

Anonymous User — Sun, 12 Dec 2021 16:54:47 GMT

Rats. Looking at the error message again it starts with a ValueError. Maybe try catching both (TypeError thrown in for good measure):

except (ValueError, SystemError, TypeError):
    pass

if those don't catch it, maybe defaulting to catching all through using just Exception:

except Exception:
    pass

Re: Using Python to make XY Event Layer; get an error but the code continues

deleted-user-nik7HiqJkbED — Fri, 13 Mar 2020 22:23:10 GMT

Thanks so much for the alternative ideas! I will give those a try on Monday

I hope you have a great weekend!

Sophia

Re: Using Python to make XY Event Layer; get an error but the code continues

BlakeTerhune — Wed, 18 Mar 2020 15:16:26 GMT

The suggestions from Jeff Kling‌ are effective but be careful catching and passing on a wide range of errors because you'll never know if there's a different problem you actually need to address.

Re: Using Python to make XY Event Layer; get an error but the code continues

deleted-user-nik7HiqJkbED — Wed, 18 Mar 2020 22:28:47 GMT

Hi Jeff,

Thanks very much for the suggestions. I tried:

try:

XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except (ValueError, SystemError, TypeError):

pass

try:

XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except ValueError, SystemError, TypeError:

pass

try:

XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except ValueError, SystemError:

pass

try:

XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except (ValueError, SystemError):

pass

try:

XYEventsFL = ap.MakeXYEventLayer_management(CleanedIncidentsPath, "Longitude", "Latitude",XYEventsTemp, WGS84, "")

except Exception:

pass

but unfortunately none of the above have prevented the errors from running. It appears that an error is triggered for each row in the csv table being used to make the XY Event layer and is quite extensive (greater than 80,000 records in some cases)

I have noticed when I run the code thru IPython in the 10.8 version or thru Jupyter notebook in the 10.8 version the error is not triggered….

It seems really surprising to me that even Exception did not work….I feel I may be grasping at straws in light of this seeming override command not having any effect but do you by chance have any other thoughts? Perhaps I did not write the code correctly?

Thanks very much for the help!

Sophia

Re: Using Python to make XY Event Layer; get an error but the code continues

DanPatterson_Retired — Wed, 18 Mar 2020 22:39:01 GMT

Have you tried just taking the try-except block out so that you get a 'failure' and the code stops?

Some reading

python - Why is "except: pass" a bad programming practice? - Stack Overflow

Re: Using Python to make XY Event Layer; get an error but the code continues

Anonymous User — Wed, 18 Mar 2020 22:45:04 GMT

Well, I think in your attempts that have tried pretty much covered any combination options... I am kind of wondering if it is a mismatched package issue, seeing how its fine in python 2 (10.8) and 3 (3.6) it's not. I get a ton of GDAL DLL errors in python 3 from the cloned environment, which I believe is caused by mismatched versions of the GDAL files and the version that the module is requesting.

Maybe look at if the package needs to be upgraded/ downgraded a version?

Re: Using Python to make XY Event Layer; get an error but the code continues

Anonymous User — Wed, 18 Mar 2020 22:47:06 GMT

Originally she had it without the try except and the code ran fine; She was just trying to stop the errors from printing and possibly confusing the client.

Re: Using Python to make XY Event Layer; get an error but the code continues

DanPatterson_Retired — Wed, 18 Mar 2020 22:58:14 GMT

How about running it in something other than a jupyter notebook? That would rule out a whole load of other issues

Re: Using Python to make XY Event Layer; get an error but the code continues

MichaelVolz — Wed, 18 Mar 2020 22:58:35 GMT

Have you ever tried this geoprocess using ModelBuilder instead of pure python? I only say this because I have a geoprocess in ArcMap where an xy event layer is updated using a model every 5 minutes. I recall trying to export the model out to python but it never worked in a pure python envionment so I reverted it back to a model and it is still running. Just another option to try if this method does not work.

Re: Using Python to make XY Event Layer; get an error but the code continues

deleted-user-nik7HiqJkbED — Thu, 19 Mar 2020 14:33:36 GMT

Dan,

That is an interesting idea- I believe I have done so…I have run it in ipython and in the python window thru ArcMap but both generate the same extensive error list…The only time I don’t get the error is when I run it at home in 10.8. But at work our servers are older and 10.8 and Pro 2.5 do not support them so the client will have to run them in 10.7 or Pro 2.4 until we get our servers upgraded.

I have been using the Jupyter notebook extension since arcpy was integrated. I am wondering your perspective on this per this comment- is the integration still fairly buggy? Do you have an alternative preference?

Thank you!

Sophia

Re: Using Python to make XY Event Layer; get an error but the code continues

deleted-user-nik7HiqJkbED — Thu, 19 Mar 2020 14:39:00 GMT

Thanks for the suggestion Michael. I have tried it in model builder and it works fine. Unfortunately the client has limited GIS and python capabilities so I was trying to create a method that would have limited user tinkering…which is of course less than ideal but…. The current script continues to run- it just generates an mass of errors that are rather alarming. The errors don’t stop or break the code though. I just wondered if there was a way I could write in an exception handle to hide them since they are more like alarms than errors. Which is weird to me.

Sophia

Re: Using Python to make XY Event Layer; get an error but the code continues

DanPatterson_Retired — Thu, 19 Mar 2020 15:54:07 GMT

So you don't have access to another Python IDE then?

Before I send you down that rabbit hole, sounds like you a running in a restricted environment and not in control of what you can use or do on your machine.

If you have some control, and do have an IDE other than jupyter, my suggestion was to try it to rule out issues. jupyter is fine...just not as fine as other python interfaces

My blog has loads of posts about Spyder (python IDE), cloning (for Pro) and the like. I wouldn't go there as a solution to your immediate problem however. It just sounds like you have to use what you have got and continue to serve-the-servers, rather than the other way around.