topic Re: Field has invalid html content in ArcGIS REST APIs and Services Questions

Field has invalid html content

NathanHeick — Wed, 30 Aug 2017 16:17:37 GMT

Does anyone know the specific details about the above error message? I receive it when I try to add features through the REST API for a hosted feature service in AGOL. The features have a field with one or more HTML hyperlinks as shown below:

The REST API does not like the & and = characters in the URLs. It does not complain about the HTML, just the use of URL parameters. When publishing the service from ArcMap, the data is loaded as is into the hosted feature service and displays perfectly. I have several workarounds ready, but I would like to get the REST API to work using the addFeatures endpoint. I need to automate updating the service and I would prefer to avoid republishing the service each time, or using Arcade and custom HTML popups.

Thanks,

Nathan

Re: Field has invalid html content

dmacq — Wed, 25 Apr 2018 15:48:53 GMT

We're having the same issue when trying to update a hosted feature service in AGOL using Python. It also appears to be causing issues when copying content in AGO Assistant. Any luck with this?

Re: Field has invalid html content

NathanHeick — Thu, 26 Apr 2018 22:06:18 GMT

Yes, I was able to update the hosted feature service using Python, but I had to republish the service each time from an MXD. This process is fairly involved. You have to create a service definition draft, analyze it, generate a service definition, upload the service definition to ArcGIS Online, republish the service from the service definition, and reapply the service item info and item data to the overwritten service. Creating the service definition draft involves arcpy.mapping and modifying XML. To make the primary REST API requests, you have to make many other requests to look up the service and service definition item ids, item info, item data, item metadata, item folder id, and item folder name based on the service name. Uploading the service definition is a multipart asynchronous process. Publishing the service definition is also an asynchronous process that multiple REST calls. Finally, when you overwrite the service definition and service items, you lose most of the item info, item data, and metadata in the process. This requires more REST calls to reapply that information to the new service definition item and the updated service item. This is necessary to retain your popup configurations, item descriptions, and any item properties you usually set in AGOL.

Also, the AGOL Assistant probably uses the same REST endpoint (applyEdits) to update item data, so it makes sense you would get the same issue.

Thanks,

Nathan

Re: Field has invalid html content

dmacq — Mon, 21 May 2018 14:13:35 GMT

Thanks, Nathan.

I'm not sure if this applies to your workflow. I'm adding and updating features using the ArcGIS API for Python to updated hosted feature layers on AGOL. Specifically, I'm using the edit_features method.

In my case, I narrowed the issue down to "=" in quoted URL strings. For instance, the "=" characters in this part of your string drawingNo=JO-P-0004&searchName=JO-P-0004 would have caused my script to fail. I replaced them with "%3D", and the script is running fine. I also had some unsupported tags that I had to take care of, and I'm still doing some testing, but that was my major hangup, and I've been able to move forward since fixing it.

Re: Field has invalid html content

NathanHeickLACSD — Mon, 21 May 2018 16:36:05 GMT

Yes, it has been a little while since I worked on this issue. I do remember that the main issue was the equals signs in the URLs. I suspect they are identifying URL parameters as a potential security threat. I believe that I also escaped the equals signs and that fixed the issue. In the end, for other reasons, I decided to go with using the ArcGIS REST API to republish the service the same way ArcMap does. It might have been because of unsupported HTML tags. Underneath it all, the ArcGIS API for Python uses the ArcGIS REST API, so knowledge like this applies no matter how you use it. I just wish I could have found the restrictions in the documentation somewhere.

Re: Field has invalid html content

KarenRobine1 — Tue, 17 Nov 2020 16:51:12 GMT

This is an old post but I just ran into this and found the solution. In the Advanced Feature Access settings in ArcGIS Server (under Capabilities), you need to make sure you uncheck the box that says Filter web content. I had this set for one of my services, and was unable to edit any HTML-based content in my string fields. As soon as I turned it off, it all worked. Not necessary to escape the HTML.

Re: Field has invalid html content

MichaelAugust — Fri, 19 Feb 2021 18:27:41 GMT

Thank you! This was driving me nuts, honestly never even went into advanced settings before. This was very helpful.

Re: Field has invalid html content

BillSouter2 — Mon, 05 Apr 2021 22:00:37 GMT

I recently encountered this error in ArcGIS Online using Python to copy data using REST. The issue turned out to be that a user had added the text "<Null>" into a text field in an enterprise geodatabase.

My theory is that the ArcGIS Online html validation treats the text as an unrecognized html tag and rejects the record and I can replicate the error by trying to add the text "<Null>" into the Data widget in ArcGIS Online.

Re: Field has invalid html content

feralcatcolonist_old — Mon, 17 Jan 2022 22:06:44 GMT

Did this get filed as a bug? I'm trying to over-write services utilizing the ArcGIS API for Python clone_items() and I'm running into this same issue with nulls-- --which is odd, because the initial cloning working without any issues.

Re: Field has invalid html content

SamSzotkowski — Wed, 24 Aug 2022 17:49:05 GMT

Thanks for this insight... I had a field with thousands of text values and wasn't sure which was causing the "invalid html content" error. Turns out it's just as you said.

Re: Field has invalid html content

ellipsol — Wed, 24 Aug 2022 18:51:25 GMT

I had a column with <> characters so, within a Pandas dataframe, I used regex to remove those characters. This is for an AGOL feature layer updated every few minutes.

df['unit'] = df['unit'].replace('[<>]', '', regex=True)

Re: Field has invalid html content

PeterMilenkovic — Fri, 07 Oct 2022 00:18:15 GMT

FYI for anyone else having this issues with AGOL hosted layers, there is a post that describes how to update setting's at the FeatureServer level here

https://comunity.esri.com/t5/arcgis-data-interoperability-blog/writing-html-and-other-amp-lt-and-amp-gt-tagged/bc-p/1219668#M159

Re: Field has invalid html content

ChadPeltier — Wed, 05 Jul 2023 16:01:48 GMT

For future users - the link has changed: Writing HTML and other < and > tagged conten... - Esri Community 😁