topic Re: arcpy.AddMessage() known limitation? in Python Questions

arcpy.AddMessage() known limitation?

SamyBouma_Ngock1 — Mon, 19 Jun 2017 15:53:01 GMT

No issue with my script as it is running fine but just for my information (or making sure my system is not giving up on me...),

is there a known limitation with arcpy.AddMessage not automatically updating the tool dialog box after ~65500 rows?

However, one can still see the vertical scrollbar update its position upward as new lines are 'added' to the console.

Re: arcpy.AddMessage() known limitation?

JoshuaBixby — Mon, 19 Jun 2017 17:43:06 GMT

It probably isn't coincidence that you are running into issues ~65,500 messages and the maximum value of an unsigned short int is 65,535.

I can't say for sure whether you are running into a buffer/queue limit, but it seems that way. That said, that is a fairly excessive amount of messaging (I am differentiating messaging from logging). Until you do sort out what is happening, maybe using a log file would work better since it seems you want to log millions of events.

Re: arcpy.AddMessage() known limitation?

curtvprice — Mon, 19 Jun 2017 17:46:59 GMT

Couldn't agree more with Joshua - GP messages are saved both in the current document and to the geoprocessing history by default -- kind of a bad idea to stuff many MB of text messages in both these places!

Re: arcpy.AddMessage() known limitation?

ClintonDow1 — Mon, 19 Jun 2017 20:40:58 GMT

I agree with Joshua's comment that this limitation is due to the maximum short int value.

I would recommend either implementing logging to a file instead of messaging to the GP pane as he suggests, using a progress bar, or doing some sort of batching on your messages (ie: only print every 1000 messages using a counter to determine progress)

Re: arcpy.AddMessage() known limitation?

curtvprice — Tue, 20 Jun 2017 18:04:40 GMT

Controlling the progress dialog box—Help | ArcGIS Desktop

This help topic also has the stub code to do something every 1000 records if you want to go the messaging route.

Re: arcpy.AddMessage() known limitation?

SamyBouma_Ngock1 — Thu, 06 Jul 2017 20:46:06 GMT

Well, thank you all for your feedback.

I understand that I'll have to observe some best practices for messaging and/or logging.

However, the issue I described is a reproducible one since for each run it happens at the same line number. I also noted that when clicking in the console window, line count information gets refreshed... I am not that concerned.