IDEA
|
Add the ability to filter a hosted feature layer by a subquery for both definition queries and "select by attribute" workflows. For me, I want to build a hosted view on top of a hosted layer. The hosted view would limit the results to only the "most recent record" for each ID that exists in a column. This query requires a date column and the ID column which is not unique. In a sql database this query would take on the following syntax: For the example the table we are filtering is named myTable. The column with ID's we want to group by is called myGroupID. The column with dates to use for finding most recent record is named myDate select * from myTable t1 where t1.myDate = (SELECT max(t2.myDate) from myTable t1 where t2.myGroupID = t1.myGroupID) Other scenarios are just filtering the whole table to the one with a max value over all: select * from myTable t1 where t1.myDate = (SELECT max(t2.myDate) from myTable This came up a lot with Covid dashboard data. You have a table with one row per day with various Covid numbers. Then some places you want to filter that master dataset to data from the latest row when sorted by date. In other places you want to use all the data to see trends. The operations dashboard widgets provide the extra configuration steps to do this kind of sorting and filtering. But applying the same kind of filtering to the hosted layer itself via a hosted view is missing. Now, I assume that on Esri's side this would require the underlying ArcGIS Online data platform to support some kind of SQL structure. But it wouldn't have to be RDBMS like PostGres or SQL Server. Azure Synapse allows relatively advanced SQL queries against data lakes that include subqueries and aggregation functions. Also, I assume that operations like this will add more load on the Esri systems since the filter needs to scan other rows and compare. But this is handled in RDBMS with indexes. There is already the concept in ArcGIS Online of tagging one column on a layer to be the "time aware" layer, and the trackaware GeoAnalytics tools in Pro require you to select a "Track ID" column. If we could define these columns on the AGOL layer, they could be used to selectively build indexes on the backend to optimize these kinds of queries.
... View more
04-20-2022
08:22 AM
|
10
|
0
|
542
|
IDEA
|
The new credit usage report is great for showing what users burned in terms of credits over a month or week. However, the report deployed in the Sep 2020 AGOL release does not include credit usage for feature storage, file storage, and tile storage. These missing categories make up 98% of our org's credit usage, so it doesn't help us much with looking for accounts that are using the most of our credits. Also, I noticed that the date range at the top of the report is given in UNIX Epoch integer. A date format that is both human readable and easy to parse with common BI date functions would be better, like ISO standard 8601. So rather than Aug 1, 2020 UTC appearing as 1596240000, it would be 2020-08-01T00:00:00Z.
... View more
09-30-2020
01:43 PM
|
8
|
5
|
1010
|
BLOG
|
I have 2 questions about the "Database Storage Details" report you get in the last step of your workflow. #1: Is it filtered by the dates selected at the top of the Dashboard page? or is it just giving me the storage size of the items as of the time I run the report? #2: Is it only showing the actual feature storage size separate from attachments? For example, let's say I have a 5GB layer that's comprised of 1GB of hosted feature layer, and 4GB of attachments. Is it correct to assume if I look at the item's main page I'd see the total size to be 5GB, but on this report the item would just show 1GB? Thanks for any info you can provide, Andrew
... View more
08-24-2020
01:09 PM
|
0
|
0
|
470
|
IDEA
|
ArcGIS Pro provides a nice GUI for updating python libraries used by the software. For folks like me this makes it so much easier to get started with the python features, since I don't have to worry about learning Conda. However, when I hear about a new version of the arcgis python library being available, when I go to the Python Package Manager, it is not shown as an option to update. I am curious why this flagship library from Esri is not available for update through this window when so many smaller ancillary libraries are available. I do know that the Python API help has a page explaining how to do the update via the conda terminal: Install and set up | ArcGIS for Developers . However, the instructions don't look like they've been updated since 2.2. Also, it is a little clunky to go through these steps when Pro has a feature to make updates easier.
... View more
07-29-2020
06:50 AM
|
1
|
2
|
943
|
IDEA
|
Currently ArcGIS Online allows layers to be non-editable for the public, but if the item is in a "group with update capabilities", the members of that group can add the layer to an AGOL map with full editing control and make edits. However, if these users add these layers to ArcGIS Pro, they cannot edit. I would like for the group editing ability on the layer be honored in Pro. I guess the current workaround is to make the hosted layer editable and share that with the group, then make a hosted view that is non-editable, and share that with the public. It's just extra items for us to maintain.
... View more
05-14-2020
06:52 AM
|
8
|
0
|
596
|
POST
|
FYI to everyone that you can't change the view definition for the cases standalone table from the visualization tab of the view. That tab only shows the layers with geometry and hides layers that are simple tables. So you have to add the view to a map, click the table in the contents and then click "set definition".
... View more
03-20-2020
06:02 AM
|
1
|
0
|
953
|
POST
|
I just heard back from Esri: To [re]create the [Cases Current] view add the Cases feature service to the map viewer. From Analysis open the Join Features tool. Configure your settings for the join and at the bottom check the option to save the output as a hosted view. To define the join you will do a 1:1 attribute join based on the name field, and sort on the Report Date field in descending order. You still have to manually recreate all the views, but I hope that helps. -Andrew
... View more
03-19-2020
08:57 AM
|
1
|
2
|
1807
|
POST
|
I'm dealing with this today as well. From what little I know about hosted layer views, you cannot alter the schema of the view to include new fields from the source layers, so you have to recreate them all. To make it more complex, the 'Cases Current' hosted view does some aggregation from the cases table to the related boundaries layer, so that you have one table with the most recent counts for each boundary. The view was created by Esri's solution so I don't know you can see the code for how the join is done, let alone recreate it. Hoping to get some answers this afternoon. I'll share here if I find out some tricks -Andrew
... View more
03-19-2020
08:49 AM
|
0
|
3
|
1807
|
POST
|
I'm joining two tables in ArcGIS Insights (ArcGIS Online) and I know both tables will have orphans after the join. For my analysis, these orphans need to have the column I'm measuring on converted from Null to zero. Once I create the joined table, I'm viewing the table and clicking +Field button, with the intent to create a new field that follows this logic: IF [measure_field] is null, THEN Value=0, ELSE Value=[measure_field] In the Insights calculate field window, I couldn't find a way to check if a field's value is null. Is this possible? Or is there a better way to cleanup nulls during the join?
... View more
02-13-2020
08:56 AM
|
0
|
1
|
596
|
POST
|
I'm new to insights and am new to Insights and am trying to understand the process to join several tables together for analysis. Is there a way to modify a table join after I've created it? For example, below I created an inner join, but now after inspecting the resulting data more I realize it needs to be a left join. Is there a way to make that change in the model without redoing everything? In the model window I can click the join step, and then click the pencil icon. It gives me the properties of the join, but there's no way to modify it. I guess I'm just used to model builder where you can go back and change the properties of a tool in the middle of the workflow, then rerun only the tools after that point in the model. I should also mention I'm using the new desktop version of Insights
... View more
01-24-2020
07:07 AM
|
1
|
1
|
612
|
IDEA
|
If it's not in there already, this is great time to add this ability into the new Map Viewer that's going into Beta. Map Viewer Beta: Coming Soon I have been able to label stream layers in Pro, but the moment you publish the Pro map as a service to Enterprise, the labels no longer appear for the end user. Last time I tried was Pro 2.3 and Enterprise/GeoEevent 10.6.1
... View more
10-16-2019
12:58 PM
|
0
|
0
|
1496
|
IDEA
|
If it's not in there already, this is great time to add this ability into the new Map Viewer that's going into Beta. Map Viewer Beta: Coming Soon I have been able to label stream layers in Pro, but the moment you publish the Pro map as a service to Enterprise, the labels no longer appear for the end user. Last time I tried was Pro 2.3 and Enterprise/GeoEevent 10.6.1
... View more
10-16-2019
12:58 PM
|
0
|
0
|
1426
|
POST
|
Update: For the basic dyamic date filter (Query #1), I did find some detail in the REST API help. Although I'm using Pro instead of the REST API, they do have some notes in the Feature Service/Layer Query method on the WHERE parameter: Query (Feature Service/Layer)—ArcGIS REST API: Services Directory | ArcGIS for Developers . However, It still didn't work. I entered the following query in Pro, and although the query validates, the layer still shows records older than 1 day. gpstime >= ( current_timestamp - interval '1' day)
... View more
10-14-2019
10:14 AM
|
0
|
1
|
898
|
POST
|
I have some AVL data hosted in a 10.6.1 spatiotemporal big data store. I'm trying to apply some filters in Pro based on the GPS timestamp but it's not working. The Pro documentation covers supported functions for the traditional RDMS, shapefile, and file database formats, but doesn't discuss compatibility for the newer ArcGIS Online, Relational Data Store, and Spatiotemporal Data Store options. Specifically I'm trying to do two queries on a single spatiotemporal hosted feature layer and contains historical vehicle location data. The point layer has a VEHICLE_ID column to store the unique ID for each vehicle, and a GPSTIME field for the time the location was caption. Query #1: Filter the dataset to only records with a timestamp in the last 24 hours. I tried a def. query GPSTIME > (CURRENT_TIMESTAMP() - 1), but that returned an expression error. Query #2: Filter the dataset to only the record with the latest timestamp for each vehicle_id. I believe with a traditional RDMS, this type of query can be handled with a whereclause along the lines of the following: gpstime = (SELECT max(gpstime) from MYGPSTABLE WHERE vehicle_id = MYGPSTABLE.vehicle_id)
... View more
10-14-2019
09:35 AM
|
0
|
3
|
1134
|
POST
|
Thank you Brian. I've heard from another source that the typical frequency can very, but 3-5 seconds up to minutes is possible.
... View more
10-01-2019
07:45 AM
|
1
|
0
|
1404
|
Title | Kudos | Posted |
---|---|---|
1 | 07-28-2022 08:55 AM | |
4 | 12-14-2023 07:15 AM | |
6 | 12-14-2023 06:52 AM | |
3 | 11-08-2023 06:34 AM | |
5 | 07-14-2023 07:32 AM |
Online Status |
Offline
|
Date Last Visited |
yesterday
|