Latest Contributions by KimOllivier

prefix = '\"%s\"' % sys.prefix !conda install --yes --prefix {prefix} geopandas

I am interested in your workflow. I do an identical task. I prototyped it in Pro and then moved it to a Notebook online. I could not use arcpy online, only arcgis so I found Pandas did help. If you get feedback that you don't have edit rights reported then I would take notice. I get this sort of thing, such as arcpy.Exists() not finding a file. Note that Esri has just completely revamped user roles, licencing, permissions. Have a look at the new system. Are you the owner of the FeatureLayers?

Still a problem for me at Sept 2024. Sort of works if you add a WFS source from the MapViewer, but not if you add it as a FeatureLayer. It ignores the layer dropdown list and just picks the first one.

The only way I have done this is by using the Python API and Pandas to find the maximum value and then update a field

"Not all Arcade functions are suitable for every profile. For example, profiles that execute expressions for all features in a layer (e.g. visualization and labeling) don't allow expressions to access data via FeatureSet functions." I don't think you are allowed to use Arcade in a map filter because of the overhead implied. You will have to process the highest value earlier before the data is in a MapView.

It can be done everywhere else! Dashboards can do it. Pro can do it. ArcView 3 could do it. There was a concept plugged by Esri as a 'join by shape field' that was intuitive and spacey. What else is more fundamental in a GIS? There is a manual tool that does an Intersect to a new static Feature Layer that also costs a lot of credits, not good enough.

I appears that the field item is not recognised as numeric. I am also wrestling with WFS feeds being read only and intermittent. My idea is to copy the WFS feed to a real Feature Layer daily that you have full control over the schema and also filters. This is easy from Pro, but not ideal and not automated. So maybe a AGOL Notebook with a Task to refresh each night? I found Arcade is disabled for WFS layers so that is not an option.

If you put both feature layers into a FeatureLayerCollection then you can turn them both on or off together.

I cannot get WFS to work correctly in AGOL by adding a feed as a FeatureLayer. It sort of works but ignores the layer selection and simply gets the first layer. If I use a WebMap and add a layer with a source as WFS then the same dialogs appear and the layer selection does work to produce a map layer. Fine, but it is not very useful because I cannot use Arcade on it. It is read-only. I can add a cql_filter with custom parameters. Finally I cannot export it to a FeatureLayer from the WebMap. It is slightly promising because it indicates that it might work if the bug when defining a FeatureLayer source is fixed. I really need to copy the WFS layers into a proper FeatureLayer Collection. You CAN do this easily using Pro! Set up a new WFS server in ArcCatalog, including custom parameters as required, add the layers to the table of contents. Turn off some fields, add more filters, rename layers, load metadata and edit, set up symbology. Change the download limits from 3000 to 100,000. Now just Share to AGOL! Any schema change or new data requires manually replacing the layer, watch out for caches. Now I want to automate this with Python. Particularly in AGOL using a Notebook and a Task. Seems to be possible with the new Pandas SeDF (spatially enabled dataframe) in arcgis package. Not so fast! Loading WFS features into Pandas sdf. This should be easy to do with python requests and geopandas. There are new functions in arcgis to translate from geopandas to sdf and from sdf to a FeatureLayer. You need to import geopandas so that you can read the WFS feed directly into a sdf data frame first. There is a posting noting that you cannot read a WFS feed directly into an Esri sedf. Catch 22 - you cannot import geopandas in a AGOL notebook because it is a Docker instance started up each time. It can work from a Desktop because you can set up a venv that does have geopandas. So how can I install geopandas in AGOL Notebook?

I cannot get WFS to work correctly in AGOL by adding a feed as a FeatureLayer. It sort of works but ignores the layer selection and simply gets the first layer. If I use a WebMap and add a layer with a source as WFS then the same dialogs appear and the layer selection does work to produce a map layer. Fine, but it is not very useful because I cannot use Arcade on it. It is read-only. I can add a cql_filter with custom parameters. Finally I cannot export it to a FeatureLayer from the WebMap. It is slightly promising because it indicates that it might work if the bug when defining a FeatureLayer source is fixed. I really need to copy the WFS layers into a proper FeatureLayer Collection. You CAN do this easily using Pro! Set up a new WFS server in ArcCatalog, including custom parameters as required, add the layers to the table of contents. Turn off some fields, add more filters, rename layers, load metadata and edit, set up symbology. Change the download limits from 3000 to 100,000. Now just Share to AGOL! Any schema change or new data requires manually replacing the layer, watch out for caches. Now I want to automate this with Python. Particularly in AGOL using a Notebook and a Task. Seems to be possible with the new Pandas SeDF (spatially enabled dataframe) in arcgis package. Not so fast! Loading WFS features into Pandas sdf. This should be easy to do with python requests and geopandas. There are new functions in arcgis to translate from geopandas to sdf and from sdf to a FeatureLayer. You need to import geopandas so that you can read the WFS feed directly into a sdf data frame first. There is a posting noting that you cannot read a WFS feed directly into an Esri sedf. Catch 22 - you cannot import geopandas in a AGOL notebook because it is a Docker instance started up each time. It can work from a Desktop because you can set up a venv that does have geopandas. So how can I install geopandas in AGOL Notebook?

Well it is possible in ArcGISPro without any python programming. All you do is add a WFS server, tweak the URL, add any cql_filter expressions and get the layers listed. Add these to a map and tweak symbology, visible items and definition queries, layer names etc. Then select all the layers and Share>featurelayer>publish. This will create a better FeatureLayerCollection in AGOL. Why better? Because you can edit, make WebMaps and anything else. The only drawback? It is not dynamic. But wait, neither is WFS usually. The one I have just extracted only updates nightly anyway. So how can you replicate this in Python. In principle duplicate the steps: 1. Use the requests module to set up a request on the WFS endpoint just like the WFS server 2. Download each sublayer as a json extract and move into a Pandas SpatiallyEnabledDataFrame. Not quite so easy in AGOL because the geopandas module is missing. In principle it should work but is not supported directly. But you can copy a geopandas dataframe to an esri spatialdataframe. 3. upload the sdf to AGOL with the GeoAccessor esri extension to arcgis. If the WFS data can be queried for changes you could use the gis.content.edit() functions to just add new records. Don't know about delete records.

The arcgis python API is a rest interface, not a relational database. Everything is atomic and restful. This means you cannot edit a single attribute in a record. You have to retrieve the whole record, edit the attributes you want and post the whole record back into the online feature layer. Because the REST interface is Stateless. It does not remember anything you have done, which record you edited etc. Its like a whole new phone call to a new support caller without a log. You have to explain the issue all over again. I liken it to having string puppets digging a hole with a shovel instead of you just doing it with a shovel yourself. The puppet is clumsy and very poor at digging holes. You cannot use the arcpy package to edit online data. You have to use the arcgis package.

Thanks for that explanation. It does show why it is happening. But the option switch says "to use field types that are compatible with ArcGISPro 3.1", which are long integer. So even if it is correct to move 64 bit fields in Sqlite to BigInteger they do not work in Pro for many functions if they are cast that way. This must be a problem with other databases in Enterprise too. I suspect they had a very narrow view of this problem when implementing the option. All I am asking for is for the switch to work everywhere.

‎06-07-2024

I wouldn't be using float values for relates. That will be very unreliable with rounding errors. The only solution if you have very large integers is to convert them to text strings. This has happened to me in the past with very large prefixes added in Oracle to merge databases creating 13 digit integers with lots of zeros. If you use text then it will still preserve the IDs even in Shape (😂) files. And now BigIntegers are appearing that do not work in most applications, relates or whatever. If Long Integer is not enough, then Text is the best option there too. Census tracts are very long numbers and sometimes they have leading zeros that are significant. Text fields will preserve these.

‎05-23-2024

Ok, post up the table schema and attribute schema and your relate expression. there are two types of relate, a Map relate (in memory) and a database relate (stored in the database). Are both primary and foreign key fields the same? Are they indexed? If they are characters lots of things go wrong with case, leading or trailing blanks, unicode. It is safest to use integers but now esri has wrecked things with Big Integers that don't always work. What are you expecting with a relate? It is not a join. You can see related records with a popup, or a selection can be transferred with the hamburger options on the table. Otherwise fairly useless for mapping.

Online Status	Offline
Date Last Visited	yesterday

My Ideas

Latest Contributions by KimOllivier

Re: Add geopandas package to AGOL Notebook

Re: Python Script Not Working Anymore: Join + Field Calculate on HFC

Re: Problems with WFS on ArcGIS Online

Re: Filter a layer using a dynamic relative-value

Re: Filter a layer using a dynamic relative-value

Re: In web maps, enable spatial filtering by a second layer

Re: Filter a layer using a dynamic relative-value

Re: Can you link 2 layers so that one appears only when another is visible?

Add geopandas package to AGOL Notebook

Re: Problems with WFS on ArcGIS Online

Re: Adding WFS to webmap using Python API

Re: API for python spatial.to_featureclass - maintain attachments?

Re: Environment setting to default Integer to Long not BigInteger

Re: Model builder calculate field, from iterate fields to new field

Re: Relate Tool not Working

Relationship Classes cannot use BigInteger fields

Re: Relate Tool not Working

Environment setting to default Integer to Long not...

Re: How transpose a point on a line

Re: Using python to calculate attribute of point f...