idea #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map in ArcGIS Online Ideas

#ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

BillFox — Mon, 06 Aug 2018 15:54:17 GMT

User Story:
Overwriting a service is a commonly used workflow by users to be able to update their data and see the changes automatically reflected in web maps or apps. However, properties that are also controlled by the web map JSON like symbology do not automatically update. This is not intuitive to users, as they do not understand that their web map is tied to JSON code on the back end. What the user sees is that they made a change to their service and the service is not updating.

This can be especially confusing if the user adds a layer to an MXD, overwrites their map service, and opens their new web map. The web map JSON points to /MapServer/0, /MapServer/1, etc, but does not display the newly added /MapServer/2. This leads the user to believe the publishing or the web map is broken because their layer did not update.

There is also an argument to be made for the reverse. When a user updates a service with new symbology or additional layers, existing web maps may not need to be changed. Imagine another user in the company who needed the symbology to be a specific symbol for a specific web map. When the service is overwritten, the web map creator does not want the symbology to change.

This usability issue has been brought up in numerous enhancements and bugs:
NIM099148
NIM085436
BUG-000092554
BUG-000093880
ENH-000094254
ENH-000080928

Each of these bugs and enhancements have been closed as expected behavior, and that symbology should be set at the web map level. Imagine a company that is adopting a new color scheme, or a new logo, and needs to have all symbology in web maps changed to reflect the new branding. This is a tedious task for users with a large number of web maps.

To reset the symbology, etc, the current workflow is to remove and re-add the layer to the web map. This is not a feasible solution to some users, as that means pop-up configuration, filters, etc, will be lost. We can direct users to copy the JSON for the layer prior to deleting it and pasting it into a JSON editor like AGO Assistant, but users should not have to modify back-end code to preserve pop-ups.

Steps to Demonstrate:
   1. Publish any map or feature service from ArcMap or Pro to ArcGIS Online, Portal, or ArcGIS Server
   2. Create a web map and add a the service to it, save the web map
   3. In Pro or ArcMap, open the same source data set and change the symbology.
   4. Overwrite the service using the Overwrite workflows
Pro: http://pro.arcgis.com/en/pro-app/help/sharing/overview/overwrite-a-web-layer.htm

ArcMap: http://server.arcgis.com/en/server/latest/publish-services/windows/overwriting-a-service-in-arcgis-for-desktop.htm

5. Open the web map created in step 2, the symbology changes made in step 3 are not reflected in the web map

Below is the request for functionality enhancement:
6. Open the "More Options" under the layer name in the web map (three blue dots) > choose "Reset Layer"

ArcGIS Enterprise‌

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Anonymous User — Sun, 03 Feb 2019 19:07:54 GMT

And...

option to use layer name instead of layer ID number for services in web maps

webmaps that do not corrupt with republishing

Webmaps indeed can use all these concepts in our threads. Symbology doesn't update, popups don't, etc. Even though the unique layer IDs work great on Server now (republishing destroyed a webmap if layers were added pre-10.3), a service still needs to be completely re-added if you add more layers or remove them, change other things in them etc. And there might be intricate popups, symbology, etc you had set in the web map. (it would be nice to back those up somehow in a webmap 'config'; more robust than the Assistant) That is why I try to do as much as will be needed from the service side, and save only a few things for the webmap to set, as they will always get blown out. (And of course we can't group layers or re-order some types or mix and match sublayers etc) I'm not sure how it would work but in theory, if you add layers to a service, they should just get picked up by the webmap and "just work". If symbology or something else in the service changes; again, it should just 'work', and update automatically.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Anonymous User — Mon, 04 Feb 2019 16:28:31 GMT

I have also wired the Layer List to click certain layers open or closed, because of the lack of partial check boxes and ability to turn sublayers on in one click (like AGS JS TOC); while that is a separate issue, it relates to this. Also the Share links where you can embed a parcel address or ID in to the URL and have sites link in to your map viewer, relates. How?? Well, the service and sublayer both get a suffix id in AGOl in the webmap. Let's say, 9233 for the service and 124 for layer 124 in the service. So YourSite.com/query=YourService_9233_124_ %2CPROP_ADDRESS%2C110%....... would open to that parcel. Except, because we have to always be blowing out layers because of the issues above. So the service suffix i.e. 9233 always gets changed. Next time it could be 8875. or something. So the node I grab which has that ID changes, so I have to update that in the Layer List widget I have hacked do automatically expand sublayers for some of the layers. Also the backend to sites that link in to use would have to change and update their stuff. (sometimes, that is a big ask) So this is an issue for enterprise sites which currently necessitates more work to update when layers change, and more places for things to go wrong. The more stable web maps are and become the better it will be for efficiency and reliability.

Two solutions: One, is make webmaps automatic and resilient, so we don't have to always Re-add the service, but it will pick up the fact there are new sublayers or other things from the MXD/service. Second, I was wondering if perhaps we could elect to keep those 'suffices' static? So it would stay 9233. So it would remain 9233 and not become 8875 for example.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

BillFox — Mon, 04 Feb 2019 16:39:20 GMT

Reference:

https://community.esri.com/message/789760-arcgis-online-overwrite-feature-service-from-arcgis-enterprise-and-new-layer-does-not-show-up-in-agol-web-map

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

GregorRadlmair — Tue, 19 Feb 2019 09:34:47 GMT

see Workaround in https://community.esri.com/thread/215875-new-ags-mapservice-layers-not-showing-in-agol-webmap : in AGOL Assistant j can edit the WebMap's JSON.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Anonymous User — Tue, 19 Feb 2019 14:21:27 GMT

I have used the assistant. It is often very useful, I recently used it to swap all service links from http to https for example in all web maps.

However, synchronizing services with web maps should be automatic: if I add a layer to an MXD or change a layer symbology or other aspects in the MXD and republish, it should be picked up by the web map automatically and immediately. Second, the Assistant states it is unofficial and not supported. Since web maps can't be backed up (Save As creates new web map, new URL, works as a backstop but is not as ideal as having a true back-up that can instantly be restored with same URL) I am hesitant to use an unofficial product on production services.

Also, when they update AGOL they could store the config of the layer list either in the web map json or WAB. But, I want the option to have some layer groups/sublayer groups expanded. I use click() now which refers to the node with the 'id' i.e. _3209 appended to each node but that changes each time I have to re-add layers to the webmap because they have this bug with not refreshing to service updates. So, this problem will fix itself when the refreshing bug/design enhancement rolls out, but perhaps this could also be another enhancement and stored via web map json, hence relevant to mention here. I would really like those layer_id's to remain static, so Share does not break with links.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

BillFox — Mon, 22 Apr 2019 16:16:32 GMT

The TLS issue has elevated this issue now that most of our web app builder apps must be updated/changed to accommodate agol connections.

Some of the applications survived and some are "corrupted" that will probably need to be rebuilt with new services, web map and web appbuilder applications.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Anonymous User — Wed, 24 Apr 2019 15:26:23 GMT

Bill, I think many orgs are seeing this as well. I hope the 4.x milestone AGOL update will address this. I just ran in to this with a few webmaps. I simply added a layer or two to a service, and then.... they don't appear in the web map. (a known issue) I have to re-add the data, redo all the popups, and redo all the other settings. It is stressful if it is a production viewer as I need to carefully re-check all of this configuration.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Anonymous User — Fri, 03 May 2019 16:37:39 GMT

A more vital issue from this bug... I realized it completely breaks the Share widget in the WebApp Builder, which is an amazing, amazing feature. Truly an amazing functionality. For example this URL zooms to an address https://www.sagis.org/map/?query=SAGIS2018allLayers_9233_124%2CPROP_ADDRESS%2C10%20WESTGATE%20BLVD%20SAVANNAH%20%20%20%20%20 Or I could do it by PIN or Name etc etc. But... if I add a layer to my viewer service, which is inevitable... it will change the "id" (9233) of the layer/service in the webmap.

This prevents integration of Esri viewers with other systems. Because let's say another agency wants to tie into my viewer. If the ID didn't change, it'd be easy, just give them the URL and tell them to append the PIN or Address or whatever, to the end of the URL. Presto, it zooms the map to a feature based on a query. But.... the second I re-add the service, this will break because the ID 9233 changes to another number. Now all they would have to do is update their URL. But... asking a government agency to repeatedly change something is definitely not feasible. It just won't get implemented unfortunately, no matter how quick the change, it requires a change which means not feasible.

I suggest this ID remain static and unique not change. Even if we re-add the service, it should know it is the same service and have the same ID or even allow us to update the ID. I'm sure I could change this in the JSON but I don't want to change something so drastic in webmap raw JSON unless I know it won't have any other ramifications.

Can anyone from Esri comment on this? Kory Kramer The Share widget allows for amazing integration of Esri viewers with other systems - however, this issue a complete roadblock until we can get the ID to remain static. Somewhat secondarily, it affects customizing the layer list because the ID gets baked into the DOM as I noted above. Not too bad for me to just update the DOM ID references. But asking other agencies to update production systems like the tax assessor each time I add a layer will not be feasible.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Anonymous User — Tue, 22 Jun 2021 09:03:45 GMT

This is still a problem. I update a webmap, I add a layer, it has a new layer Id. It does not show up in the webmap. This is a PITA. This was necessitated by another common workflow problem; new attributes not captured in Unique Values symbology https://community.esri.com/ideas/17688

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

GarrettMcBride — Mon, 05 Oct 2020 22:53:55 GMT

Anyone ever figure out a workaround for this? When we add new features, then republish...the webmap doesn't update. Adding/Removing services in the webmap gets old as discussed above due to losing labels, popups, etc configurations. Any update would be appreciated! Using Portal, not AGOL.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Anonymous User — Wed, 18 Nov 2020 23:20:56 GMT

This is definitely a very large requirement this should be automatic to all maps unless a layer has had specific customisations applied. But there should also be a button in the webmaps when you are configuring a layer to reset it back the defaults of the service layer.

Reset all parameters to current service parameters
Reset symbology to service parameters
Reset labels
Reset pop ups etc.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

BillFox — Mon, 22 Nov 2021 16:38:13 GMT

Hi Garrett,

Not that I know of yet.

I'm hoping Esri will include a comprehensive "Enhancement Priority & Status" web page so we can get some sense of almost there or not gonna happen.

The "Under Consideration", "In Product Plan" labels could be enhanced with something like this:

"Enhancement request <XYZ> is currently number 123 in our Under Consideration queue."

And,

"Enhancement request <XYZ> is currently number 123 in our Product Plan queue and is targeted to be included as listed on our Product Life-Cycle / Road Ahead web pages."

Maybe ArcGIS Enterprise is in a similar cycle as ArcMap => ArcGIS Pro with this level of enhancement being pushed to ArcGIS Enterprise on Kubernetes.

Any additional status updates would help us plan accordingly.

https://community.esri.com/t5/arcgis-online-ideas/enh-000108149-enhancement-allow-the-option-to/idc-p/1117344#M8470

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Thomas1 — Tue, 01 Mar 2022 10:01:25 GMT

ESRI, when this essential enhancement will be available????

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

ahargreaves_FW — Tue, 09 Aug 2022 20:12:34 GMT

Maybe @KellyGerrow could tell us? I've Cross posted here and here.

Re: #ENH-000108149 [Enhancement] Allow the option to refresh or reset a service in a web map

Thomas1 — Fri, 05 Jan 2024 11:32:33 GMT

Maybe @MarianneFarretta could help us?