topic Re: Cannot load WFS, GeoJSON, KML with Add layer from URL in ArcGIS Online Questions

Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Fri, 04 Aug 2023 17:39:59 GMT

Veneto Region Environmental Agency publishes meteorological data in several formats:

Available formats

but when I try to use them in ArcGIS Online with the Add layer from URL command

Attempt with GeoJSON format

I receive this error message:

Error GeoJSON

I have a similar (in some cases different) error with every format.

The only format working is the CSV format, but I can't use it because of the way the coordinates are managed (in a unique geom field)

I give here the URL of different formats available in Add layer from URL (none of the works) if someone can test them:

WFS (I understand in this case is a version issue)
GeoJSON
KML

Thanks

Roberto Rossi

Padua University

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

MiguelParedes — Mon, 07 Aug 2023 07:03:40 GMT

Greetings @RobertoRossi
I have been trying to test some of the formats you described in your posting, but unfortunately, https://gaia.arpa.veneto.it/layers/geonode:v_ieri_temperatura is unavailable. Do you know if there are problems with it?

I will try later when the site is running again.

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Mon, 07 Aug 2023 10:32:20 GMT

Thank you @MiguelParedes

At the moment https://gaia.arpa.veneto.it/layers/geonode:v_ieri_temperatura works (at least for me).

Roberto

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

MiguelParedes — Tue, 08 Aug 2023 06:59:01 GMT

Greetings @RobertoRossi

Still no joy for me. I have even gone to the following site to try to gain access:
https://civil-protection-knowledge-network.europa.eu/organisations/agenzia-regionale-la-prevenzione-e-protezione-ambientale-del-veneto but when I click on the link to go to https://www.arpa.veneto.it I get a failed page.
In any case, I have seen the URL you provided in your first screen capture and you have added a GetFeature request for a WFS, which is not the correct URL. To add the WFS try using the following instead:
https://gaia.arpa.veneto.it/geoserver/ows
You should get a list of the layers in the service that will allow you to select the layer for "temperatura".

Also, I have noticed that the requests for GeoJSON and for KML are all directed to the WFS service, specifically to the Layer named (typename) geonode.v_ieri_temperatura, and outputFormat of JSON and KML respectively. So I think the problem with GeoJSON and KML URLs is their complexity.

I hope the above is of help.

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Tue, 08 Aug 2023 12:38:55 GMT

Thank you again @MiguelParedes ,

I cannot understand why you cannot load the Arpav URL and pages.

I supposed it might be a problem of accesses from foreign (from Italy) countries, or access from USA, but I tested them with a friend in USA and everything seem to work. I also tested with Free Website Reachability Check (like Semonto or Uptomio), and the test is OK (https://semonto.com/tools/website-reachability-check?test=8b8404b2df8dbb957a82609fa60097f0a).

Anyway, I verified that using the URL you suggested, https://gaia.arpa.veneto.it/geoserver/ows, instead than the one provided in the page solves the problem "This version of WFS is not supported". Anyway WFS it's not the best format to load data (as you may now). For example I have problems with actions on dashboards.

To try to solve the problem of GeoJSON and KML what can I suggest to people in charge of publishing the data? Something like "do not use a WFS service with an outputFormat parameter, but..."?

Thanks again

Roberto

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

MiguelParedes — Wed, 09 Aug 2023 07:40:16 GMT

Greetings @RobertoRossi,

I am based in the UK, and for some reason, I do not have access to that particular site. However, I have a colleague who through the use of a VPN was able to access the site and provide me with a copy of the Capabilities document for the WFS service, and according to it should support versions 1.0.0, 1.1.0 and 2.0.0. Usually, and by default, the ArcGIS Online client apps (MVC and MV), would request the latest version first, in this case, 2.0.0, so I don't know why you would be getting the message about the version not being supported. It is hard to say without being able to have access to the WFS.

Using the WFS to provide the data in GeoJSON and KML and other supported output formats, is a perfectly valid option, and using them should allow one to add the data as a layer to the Content in ArcGIS Online or directly to one of the above-mentioned clients, but again, without being able to test it I am not sure why the URLs are not working with ArcGIS Online.

I know this isn't much help but maybe other Community users that have access to the service might be able to offer further guidance.

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Thu, 10 Aug 2023 11:12:59 GMT

Thank you @MiguelParedes for your efforts and suggestions.

I got in touch with Arpav Agency IT technicians which told me "At the moment we block access on a geographical basis, starting from the assumption that our services serve Italy and neighboring countries" (so strange and disappointing in my opinion!).

Actually the Website Reachability Check (https://semonto.com/tools/website-reachability-check?test=8b8404b2df8dbb957a82609fa60097f0a) says the service is not reachable just from UK (it's reachable form USA)!

I'm going to ask them to remove this block.

------------------------

Summarizing, after your suggestions, at the moment it will be interesting for me to understand why URL like

https://gaia.arpa.veneto.it/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=geonode%3Av_ieri_temperatura&outputFormat=json&srs=EPSG%3A3003&srsName=EPSG%3A3003

are not working in ArcGIS Online.

The strange thing is that I saved the JSON file (it's attached here as zip file) and then succeed in loading it on ArcGIS Pro using JSON To Features tool.

If I try to Add Layer form file with ArcGIS Online, I get the unsupported GeoJSON 'crs' member error, also if I load a file in EPSG 4326 or EPSG 3857 CRS.

So it would be interesting to understand why ArcGIS Online is not able to load using Add layer form URL a JSON service which gets a JSON file which is OK with Pro. Maybe something in the URL syntax?

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

MiguelParedes — Fri, 11 Aug 2023 07:21:01 GMT

Greetings @RobertoRossi

Thank you for finding out. No wonder why I was not able to access the service.

With respect to the GeoJSON files you provided, I was able to add them to Content in ArcGIS Online and then to the Map Viewer:

Since I do not have access to the service you are using, I decided to enable the WFS capabilities in an ArcGIS Server 10.9.1 Sample World Cities default service and try if I would be able to add the GeoJSON and KML links into ArcGIS Online, so:
https://<server>.<domain>/server/services/SampleWorldCities/MapServer/WFSServer?request=GetFeature&service=WFS&TypeName=Cities&srs=EPSG:4326&outputformat=GEOJSON
and
https://<server>.<domain>/server/services/SampleWorldCities/MapServer/WFSServer?request=GetFeature&service=WFS&TypeName=Cities&srs=EPSG:4326&outputformat=KML

I was able to add both services to the Content using the +Add item > URL

Interestingly, when I checked the GeoServer guide for WFS 2.0.0 for GetFeature I found that the parameter for specifying the CRS is srsName. In the Esri WFS, it is srs only. I would suggest trying the URL again but with only srsName, committing the srs parameter:
https://gaia.arpa.veneto.it/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=geonode:v_ieri_temperatura&outputFormat=json&srsName=EPSG:3003

Hopefully, that will work for you.

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Thu, 31 Aug 2023 13:01:35 GMT

You're right @MiguelParedes! It seems that in ArcGIS Online we should only use the srsName parameter, without the srs one, when we load WFS URLs...

I was able to load the JSON in ArcGIS Online, but only as hosted feature layer and not directly form the URL:

If I try Reference the file from the URL and add it to the map I receive this error:

Now I have to understand if the hosted feature layer I created will update automatically, when, daily, the Agency updates the data. This because my aim is to create a map and a dashboard which uses the daily updated data...

I postpone marking your last answer as a solution, waiting to check if the data in the hosted feature layer update daily.

Thanks again.

Roberto

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Thu, 31 Aug 2023 17:17:18 GMT

Hi @MiguelParedes ,

I'm back again because the Arpav agency, at my request, have today changed the publishing policies and now their service are available also from UK.

I would ask you, please, if you can check if you're able to load in ArcGIS Online Map Viewer the GeoJSON format directly from the URL (Reference the file form the URL and add it to the map). As I told you, in my last post, in this case I receive Unable to add layer error. I'm able to load the service as hosted feature layer, but in this way the Maps, and dashboard I create using that layer will not update, since the layer does not update daily as the original Arpav service does.

Thank you again

Roberto

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

MiguelParedes — Fri, 01 Sep 2023 08:19:47 GMT

Buongiorno @RobertoRossi

Thank you for requesting the change. I can confirm that I now have access to the Geoserver service from Arpav.

As a result, I have added the WFS to the Content in ArcGIS Online, and then viewed the layer Vaolri giornalieri della temperature in Map Viewer:

If I am not mistaken, updates to the service should pull through since the service is being added directly.

You could pull the layer as JSON with the URL https://gaia.arpa.veneto.it/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=geonode%3Av_ieri_temperatura&outputFormat=json&srs=EPSG%3A3003&srsName=EPSG%3A3003 save the output to a file and then create a service from it, but it will be a static feature layer:

So my recommendation would be to use the WFS.

Hope the above helps.

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Fri, 01 Sep 2023 08:59:28 GMT

Tank you again @MiguelParedes ,

yes, I'm able to add the WFS in ArcGIS Online. The updates work well. The problem is that using the service with the Dashboards, Actions (like Zoom or Pan) do not work with WFS layer. Actions work with JSON (that's the reason why I was trying to use JSON services), which, however, is only static feature layer.

At the moment I'm wondering whether reporting these 2 behaviours as bugs:

Actions do not work with WFS layers
Is not possible to load directly form URL (this) JSON service

Any advice?

Roberto

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

MiguelParedes — Fri, 01 Sep 2023 16:57:55 GMT

Greetings @RobertoRossi

Oh, I see.

To be honest, I do not think the issue with the Dashboard would be considered a bug.

I did some digging around and found an old (2020) Community posting about using WFS with Dashboards. Please, have a look at the resolution from @DerekLaw in OGC WFS Layers on a Dashboard

I would suggest proposing the functionality in the ArcGIS Ideas site.

With respect to your second point (2.) it is indeed possible to add a GeoJSON service to ArcGIS Online. Please see Add layers from a URL on how to do it. However, this will not help you because ArpaV is publishing a WFS service that supports output in JSON. But still, the service is a WFS. With this in mind, I would suggest checking with Arpav to find out if they can publish services in GeoJSON.

I know this is not probably what you were hoping to hear, but the functionality is just not there yet.

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Tue, 05 Sep 2023 15:24:15 GMT

Thank you for the assistance @MiguelParedes

I read @DerekLaw answer.

I did not know that "dashboard elements only support map and feature services from the ArcGIS platform"

Indeed, at the moment, WFS seems to work with Indicators, Lists, Details, etc... The only issue I verified is with Actions, has you can check with this Dashboard I created using Arpav WFS services.

Maybe Esri has worked on it to make ArcGIS dashboard more flexible...

Anyway I consider to propose an Idea "Please let Actions work with WFS", or something like that...

Regarding JSON, I saw that the URL syntax refereed to WFS (with outputFormat=json parameter), but I thought it should have behave as real JSON.

Thank you again for your precious assistance!

Roberto

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

RobertoRossi — Wed, 25 Oct 2023 10:27:39 GMT

@MiguelParedes

I proposed to implementation of Actions for WFS layers in ArcGIS Ideas:

https://community.esri.com/t5/arcgis-dashboards-ideas/let-actions-work-on-wfs-layers/idi-p/1341180/highlight/true

I hope my description (in my poor English) is clear 🙂

Regards

Roberto

Re: Cannot load WFS, GeoJSON, KML with Add layer from URL

JustinAnderson4 — Thu, 02 Nov 2023 23:10:26 GMT

Hello all,

I am having a similar issue. I am new at working with an enterprise environment and am getting used to all the restrictions. I have created a geojson file from my computer and have added it to a map. The geojson file shows in my content however, when I try to add it to another map, it does not show up in my content.

Is there something I'm missing? Any help would be greatly appreciated!