topic Re: Filter Most Recent Records by Time (mins) in Dynamic Data in ArcGIS Online Questions

Filter Most Recent Records by Time (mins) in Dynamic Data

Anonymous User — Mon, 25 Feb 2019 23:07:43 GMT

Has anyone needed to get the most current record by filtering on day/time of a dynamic data set (it is currently a hosted feature service in AGO)? The data is refreshed about every 10 mins. I am trying to use filtering or Arcade expressions. Thank you. Jake Skinner

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

KhaledHassen — Tue, 26 Feb 2019 14:57:49 GMT

Please check queryTopFeaature API on the feature service layer and it is available on online feature service. It is the same as query API but it will return you the most recent or oldest record/feature(s).

The key to this API is to pass the topFilter param which can specify the orderBy and groupBy fields.

topFilter:

{
"groupByFields" : "your-groupby_field(s)",
"orderByFields" : "sometime_field ASC",
"topCount" : 1 // You can return the most recent 1 or more record
}

Khaled Hassen

Online Feature Service Dev. Lead

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

Anonymous User — Tue, 26 Feb 2019 18:32:07 GMT

Hi Khaled, Thanks so much for the response and I was able to get it to return the correct records. How do I use this as a layer in my web map?

Thanks!

Tonya

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

KhaledHassen — Tue, 26 Feb 2019 18:56:45 GMT

One way to do this is by creating a view layer from this service.

You can then set the topFilter in the view. Once this is done, then you should be able to view the results like any other filter in the layer.

To set the topFilter in the view, you will need to use the layer admin API and pass the followings:

https://servicesurl/ArcGIS/rest/admin/services/view-name/FeatureServer/1/updateDefinition

{

"viewLayerDefinition" : {

"topFilter" : {

"orderByFields" : "<yourfileldName> ASC",

"groupByFields" : "your _groupBy_fields",

"topCount" : 1

}

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

AndrewHargreaves1 — Wed, 20 Nov 2019 23:24:02 GMT

Hello Tonya Kauhi & Khaled Hassen‌

I'm struggling to form my queryTopFeatures correctly. I am attempting to query the most recent record for each FacilityID in a table using the below:

https://xxxxx.com/arcgis/rest/services/xxx/xxx/FeatureServer/101/queryTopFeatures?where=&objectIds=&time=&topFilter={"groupByFields": 'FacilityID', "topCount": 1, "orderByFields": 'workdate'}&geometry=&geometryType=esriGeometryEnvelope&inSR=&spatialRel=esriSpatialRelIntersects&distance=&units=esriSRUnit_Foot&outFields=*&returnGeometry=true&maxAllowableOffset=&geometryPrecision=&outSR=&returnIdsOnly=false&returnCountOnly=false&returnExtentOnly=false&returnZ=false&returnM=false&resultType=&f=pjson

I'm unsure if it matters but know that 'workdate' is a date field. Please can I ask for help on how to form this query correctly?

Thanks

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

KhaledHassen — Thu, 21 Nov 2019 02:34:18 GMT

Hi Andrew,

I see you are passing the filter above in the url without any url encoding. This will not work.

The topFilter in the url will look like:

&topFilter=%7B"groupByFields"%3A+"Editor"%2C+"topCount"%3A+1%2C+"orderByFields"%3A+"EditDate"%7D+

Pl. note I used double quote for the group by and order by fields.

Thanks

Khaled

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

AndrewHargreaves1 — Thu, 21 Nov 2019 16:43:52 GMT

Do I encode the whole URL or only the query portion of REST URL, as below:

https://xxxxxxx/arcgis/rest/services/xxx/xxxxx/FeatureServer/101/%3Fwhere%3D%26objectIds%3D%26time%3D%26topFilter%3D%7B%22groupByFields%22%3A+%E2%80%9Cassetkey%E2%80%9D%2C+%22topCount%22%3A+1%2C+%22orderByFields%22%3A+%E2%80%9Cworkdate%E2%80%9D%7D%26geometry%3D%26geometryType%3DesriGeometryEnvelope%26inSR%3D%26spatialRel%3DesriSpatialRelIntersects%26distance%3D%26units%3DesriSRUnit_Foot%26outFields%3D%2A%26returnGeometry%3Dtrue%26maxAllowableOffset%3D%26geometryPrecision%3D%26outSR%3D%26returnIdsOnly%3Dfalse%26returnCountOnly%3Dfalse%26returnExtentOnly%3Dfalse%26returnZ%3Dfalse%26returnM%3Dfalse%26resultType%3D%26f%3Dpjson%0D%0A%0D%0A

Either way, i'm not getting any results back when i drop this into my browser. What am I doing wrong here?

Thanks

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

JayJohnsonWashoeCounty — Fri, 10 Apr 2020 16:03:27 GMT

Khaled, Can you take a look at this related question?

https://community.esri.com/message/920629-update-hosted-layer-view-definition-w-topfilter-to-show-only-most-recent-record

Thanks.

Jay

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

RonParis — Mon, 10 Aug 2020 16:44:56 GMT

Hi Khaled,

Is it possible to use topFilter to group by on geometry? My issue is that have a point feature class which is constantly being updated, and I want to be able display the most recently created features. At the moment, AGOL draws randomly, so it isn't possible to display the most recent.

Many thanks

Josh

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

KhaledHassen — Mon, 10 Aug 2020 16:59:32 GMT

Hi Josh,

No we do not support group by on geometry. Not sure I understand the issue with the display you have. You should be able to get ht most recent based on your groupby and order by you are using with the topfilter. If this is not happening, we might have an issue.

Khaled

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

RonParis — Mon, 10 Aug 2020 17:13:25 GMT

Hi Khaled,

I essentially have a point dataset of assets (fire hydrants) and a separate point dataset (inspections). The inspections sit on top of the asset dataset. Each asset has >1 inspection sat on top of it. The inspections are symbolised on an attribute called "Defect". I have an inspection with a CreationDate August 1st that says the asset is defective (coloured red), and then I have an inspection with a CreationDate of August 2nd that says the defect has been rectified (coloured green). Unfortunately in AGOL, it is drawing the August 1st feature first, as opposed to the August 2nd feature.

Ideally, I want these inspection layers to draw the most recent inspection first (on the screen, the first inspection you see the one most recently created). I do not have any common attributes in either point dataset (e.g an asset ID). The only relating factor is the spatial element I hope this makes sense!

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

KhaledHassen — Mon, 10 Aug 2020 17:27:01 GMT

If I understand this correctly, it looks like you need an order by in the view definition in addition to the top filter. We are working on this enhancement for Sept. release. Once you have the order by in the view definition, you can order by the creation date DESC which should display the features ordered by the creation date (ASC or DESC).

Is this what are you looking for?

Khaled

Re: Filter Most Recent Records by Time (mins) in Dynamic Data

RonParis — Mon, 10 Aug 2020 17:45:34 GMT

That sounds like what I'm after. Thanks Khaled