topic Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script" in ArcGIS Dashboards Questions

ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Wed, 28 Apr 2021 16:14:04 GMT

Hi,

I am very new to Arcade (which you probably be able to tell by my filter expressions below).

I am attempting to create a Data Expression that can be used to power an Indicator widget in a Dashboard. I have built and tested this in the Data Expression builder within my Dashboard and when I click "test" it returns the proper result. I click done, but then see a little triangle with an ! telling me "Unable to execute Arcade script".

Why would I see this message? My Arcade script is below. Any help would be appreciated.

var p = 'https://www.arcgis.com'; var itemID_CMpts = 'xxx'; var layerID_CMpts = 0; var fs1 = FeatureSetByPortalItem(Portal(p), itemID_CMpts, layerID_CMpts, ['Point_Status', 'EQ_File_Number'], false); var filterCMpts = Filter(fs1, "Point_Status ='Unstable' AND EQ_File_Number ='EQ2015-078' OR Point_Status ='Unstable' AND EQ_File_Number = 'Eq2013-026' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2018-082' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2018-052' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2001-080X' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2003-021' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ1989-015' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2002-023' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2002-045X' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2019-110' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2020-017' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2019-091' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2018-029' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2020-033' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2019-036' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2020-052' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2019-064' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2017-040' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2020-031' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2021-003' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2011-016' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2017-026' OR Point_Status ='Unstable' AND EQ_File_Number = 'EQ2021-020'"); var itemID_join = 'xxx'; var layerID_join = 0; var fs2 = FeatureSetByPortalItem(Portal(p), itemID_join, layerID_join, ['Point_Status_revisit', 'EQ_File_Number'], false); var filterJoin = Filter(fs2, "Point_Status_revisit ='Stable' AND EQ_File_Number ='EQ2015-078' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'Eq2013-026' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2018-082' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2018-052' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2001-080X' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2003-021' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ1989-015' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2002-023' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2002-045X' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2019-110' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2020-017' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2019-091' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2018-029' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2020-033' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2019-036' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2020-052' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2019-064' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2017-040' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2020-031' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2021-003' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2011-016' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2017-026' OR Point_Status_revisit ='Stable' AND EQ_File_Number = 'EQ2021-020'"); var CntCMpts = Count(filterCMpts) var CntJoin = Count(filterJoin) return CntCMpts - CntJoin

Thank you!

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

KenBuja — Wed, 28 Apr 2021 20:52:15 GMT

Data expressions generate a FeatureSet, so that's all you can return, not the count of your two FeatureSets.

A note about your SQL statement. You can make it much shorter using this format

"Point_Status ='Unstable' AND EQ_File_Number In ('EQ2015-078', 'Eq2013-026', 'EQ2018-082', etc)"

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Mon, 03 May 2021 20:54:36 GMT

Hi @erica_poisson and @KenBuja ,

You actually can return an in-memory featureset with the data that you want to graph. Since I am not sure what you are exactly after I will provide an example and you can adjust accordingly.

See the example below (please note that the filter expression is using the syntax suggested by Ken). The first part is pretty much the same, but after getting the counts, you create a schema for the output featureset, and fill it with the data. In this case, it will be a featureset with 3 fields and only 1 row. This can be used in the Dashboard as data source.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Mon, 03 May 2021 20:56:06 GMT

Below an example of the featureset that will be returned using some random values for the counts:

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Tue, 04 May 2021 16:02:01 GMT

Hi Xander,

Thank you for the example. I was able to get this to work using something I came up with that basically does what you showed in the example. Unfortunately, this is not quite what I need after reflecting on the results.

What I really want to be able to do is get the count of records in my point layer that do not have any related records associated with them. Is that possible using the FeatureSetByRelationshipName parameter? I've seen some other posts you have responded to around FeatureSetByRelationshipName, but none of the examples talk about doing something like what I am trying to accomplish.

Thank you,

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Tue, 04 May 2021 16:58:52 GMT

Hi @erica_poisson ,

I just had a look in the list of functions available when creating an Arcade data expression. For instance, the Attachments function is not available, but FeatureSetByRelationshipName is. I assume you published your data and related data with a relationship class. If this is not the case, you can still use the filter function to get the same result. The performance will depend greatly on the number of features you have since a loop through all features is required to get this result.

Based on the sample expression you shared, have a look at the expression below:

var p = 'https://www.arcgis.com'; var itemID_CMpts = 'xxx'; var layerID_CMpts = 0; var relationshipName = "the name of the relationship between data and related data"; var fs1 = FeatureSetByPortalItem(Portal(p), itemID_CMpts, layerID_CMpts, ['Point_Status', 'EQ_File_Number'], false); var tot = 0; for (var f in fs1) { var fs2 = FeatureSetByRelationshipName(f, relationshipName, ['DummyField'], false); var cnt = Count(fs2); if (cnt == 0) { tot += 1; } } return tot;

In this example for each feature the related features are queried and if the count is 0, the total is incremented by one. At the end you should have the number of features that have no related records.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Tue, 04 May 2021 18:45:02 GMT

I will give this a try tomorrow morning. One question...the relationship name that I put in there, is it the name of the relationship class in the fGDB from pre-publishing to AGOL?

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Tue, 04 May 2021 19:46:20 GMT

Hi @erica_poisson ,

Good question... Normally, when you edit an Arcade expression you will have access to the properties and the easiest way is navigating the interface to use the relationship. Let me visualize this.

In the expression editor you would find the $feature on the right and you can enter and find all the fields of this $feature (click on ">" in blue rectangle):

Next, at the end of the list of attributes you would find "Related records" and you can see all the relationships (click on ">" in blue rectangle)

This will show the relationship and when you click on the "FeatureSetByRelationshipName" link it will be correctly inserted in the code.

However, since you access the data in the data expression using the "FeatureSetByPortalItem" you will not find those options in the interface.

You can go to the details page of the hosted feature layer and open the REST end point:

In the REST endpoint page at the end, you will find the relationships section with the name of the relationship:

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Wed, 05 May 2021 13:56:04 GMT

@XanderBakker

Ah I see. I am perplexed by my data. This was created via Pro with a named relationship class based on GlobalID/GUID, however this is what I see via the REST endpoint. I would have expected to see the relationship class name that I defined in Pro before I published these data to ArcGIS Online.

Out of curiosity, I added this layer to a new map and went into the pop-up to add a new expression. I clicked through $feature like you mentioned, found related records at the bottom and then clicked FeatureSetByRelationshipName to add it into the builder window. This is what I see.

FeatureSetByRelationshipName($feature,"")

Here is the Arcade I attempted...I am now getting the "Unable to execute Arcade script" message again, even though it returns the correct number of records when I click "Test":

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Wed, 05 May 2021 14:21:49 GMT

Hi @erica_poisson ,

That is interesting. It returns the correct value, but it does show an error. Maybe the name for the relationshipclass that should be used has to be "Construction_Monitoring_Revisit" (I am not sure). The best way to validate this is to add the layer to the map and use the navigation in the interface when creating an expression as described earlier. Just to be sure that you are using the correct name.

I am also wondering if it is enough to return the count as a number or that a featureset is expected. I think the latter. In that case, you could use something like the expression below.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Wed, 05 May 2021 14:37:53 GMT

That worked perfectly! Thank you.

One question I do have...what are your recommended methods for someone to learn more about Arcade? I have taken the courses available through the Esri training catalog, but felt they left a lot to be desired. I do look at the Developer Reference for Arcade, but I find this less helpful in some instances.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Wed, 05 May 2021 14:53:11 GMT

@XanderBakker

One additional question has come up. In my Dashboard, I have a map. I would like to set a Map Action so that all of my indicators are updated based on map extent. When I set this, my indicator changes to display "no data". Are map actions not compatible with elements configured via Data Expression?

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Wed, 05 May 2021 15:13:29 GMT

Hi @erica_poisson ,

That is a good question. I have seen some limitations with actions configured between widgets in the dashboard (not maps) when using data expressions. It seems that if two widgets use a different data expression, they cannot be linked (even if the resulting featureset have a common key). I can understand the logic behind this, but it is kinda limiting when it shouldn't.

I don't think map actions will work because your featureset based on an Arcade data expression will not have the same schema as the data in the map (or perhaps does not have geometries to be filtered by extent). Use layer actions, it might work since you can specify the input and output fields that should match. However, it is most likely that it will not work as you are experiencing.

If the action should be related to those records that do not have attachments, the creation of the data expression featureset should include the individual geometries in order to filter those using the extent. This would be more work but might be possible (not sure though).

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Wed, 05 May 2021 15:25:50 GMT

Hi @erica_poisson ,

The Esri Training catalog and learn paths are good ways to start. The developer help can be useful to understand each function (although sometimes it might be a bit confusing). Paul Barker has written some very good blogs on Arcade, Hussein Nasser more on Arcade in Attribute Rules and David Nyenhuis on Arcade in Dashboards: https://www.esri.com/arcgis-blog/?s=#arcade

Basic knowledge of JavaScript might be an advantage, although Arcade is just a subset of JavaScript with some specific functions added.

I have published some blogs/documents here in the Esri Community, but some of them are Spanish: https://community.esri.com/t5/forums/searchpage/tab/message?filter=authorId,includeTkbs&q=arcade&include_tkbs=true&author_id=1108&collapse_discussion=true

What you did by reaching out to the Esri Community is a very good way of getting help when starting with Arcade or resolving complex challenges further along the road. There are many users that are willing to help others and that makes this community so great.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Wed, 05 May 2021 15:32:29 GMT

Thank you for this information - that all makes sense and is what I suspected. I will play around with this and see if I can figure it out.

I really appreciate all of your help and your learning suggestions.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Fri, 07 May 2021 14:00:14 GMT

@XanderBakker

Apologies for another question. I am trying to create a new data expression to populate a list with some basic information on these features that have no related records. I also want to pass through the geometry so I can then use the list to zoom to features in the map; this time I am maintaining the unique ID field "EQ File Number" which I hope will allow me to accommodate this.

The code below is kind of a Frankenstein from the code you helped me with the other day and some other code I used in a different data expression. It creates the dictionary, but when I "Test" it just shows an empty table. I had figured I wanted to do all of this within the first for loop, but I am not really sure. If you had a suggestion, it would be appreciated.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Fri, 07 May 2021 14:48:05 GMT

Hi @erica_poisson ,

The structure is a bit different. The schema is created once before the loop and you need to insert the results in the feature. When you need to include the geometry this is something you also need to include in the dictionary. I have not worked with returning geometries in data expression, but if I consult the syntax of the json it should be something like this:

// settings var p = 'https://www.arcgis.com'; var itemID_CMpts = 'xxx'; var layerID_CMpts = 0; var relationshipName = ""; // access first featureset var fs1 = Filter(FeatureSetByPortalItem(Portal(p), itemID_CMpts, layerID_CMpts, ['Point_Status', 'EQ_File_Number', 'Inspection_Date'], true), "Point_Status ='Unstable' AND EQ_File_Number In ('EQ2015-078', 'Eq2013-026', 'EQ2018-082', 'EQ2018-052', 'EQ2001-080X', 'EQ2003-021', 'EQ1989-015', 'EQ2002-023', 'EQ2002-045X', 'EQ2019-110', 'EQ2020-017', 'EQ2019-091', 'EQ2018-029', 'EQ2020-033', 'EQ2019-036', 'EQ2020-052', 'EQ2019-064', 'EQ2017-040', 'EQ2020-031', 'EQ2021-003', 'EQ2011-016', 'EQ2017-026', 'EQ2021-020')"); // create data schema var Dict = { 'fields': [ {'name': 'EQNum', 'type': 'esriFieldTypeString'}, {'name': 'InspecDate', 'type': 'esriFieldTypeDate'}, {'name': 'PtStatus', 'type': 'esriFieldTypeString'}], 'geometryType': 'esriGeometryPoint', 'features':[]}; // analysis and fill Dict var i = 0; for (var f in fs1) { var fs2 = FeatureSetByRelationshipName(f, relationshipName, ['Point_Status_revisit'], false); var cnt = Count(fs2); if (cnt == 0) { Dict.features[i] = { 'geometry': Geometry(f), 'attributes': { 'EQNum': f["EQ_File_Number"], 'InspecDate': f["Inspection_Date"], 'PtStatus': f["Point_Status"] } }; i++; } } return FeatureSet(Text(Dict));

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Fri, 07 May 2021 16:05:12 GMT

@XanderBakker

I have tried figuring this out by browsing through GeoNet but can't find anything relating to this issue...I added the console function right before the return statement at the end, because this is still returning an empty dictionary. When I hit "Test" and view the output from the console, I see this:

["features returned",{"fields":[{"name":"EQNum","type":"esriFieldTypeString"},{"name":"InspecDate","type":"esriFieldTypeDate"},{"name":"PtStatus","type":"esriFieldTypeString"}],"geometryType":"esriGeometryPoint","features":[{"geometry":{"x":-7997522.018099999,"y":5207172.07,"spatialReference":{"latestWkid":3857,"wkid":102100}},"attributes":{"EQNum":"EQ2013-026","InspecDate":"2020-07-29T16:00:00.000Z","PtStatus":"Unstable"}},{"geometry":{"x":-7997970.5297,"y":5214400.591300003,"spatialReference":{"latestWkid":3857,"wkid":102100}},"attributes":{"EQNum":"EQ1989-015","InspecDate":"2020-09-30T16:00:00.000Z","PtStatus":"Unstable"}},{"geometry":{"x":-7993994.632999999,"y":5212258.8379999995,"spatialReference":{"latestWkid":3857,"wkid":102100}},"attributes":{"EQNum":"EQ2020-052","InspecDate":"2020-10-19T16:00:00.000Z","PtStatus":"Unstable"}},{"geometry":{"x":-8002495.5656,"y":5219019.943500005,"spatialReference":{"latestWkid":3857,"wkid":102100}},"attributes":{"EQNum":"EQ2017-040","InspecDate":"2020-11-23T17:00:00.000Z","PtStatus":"Unstable"}},{"geometry":{"x":-7998590.2183,"y":5226627.4831000045,"spatialReference":{"latestWkid":3857,"wkid":102100}},"attributes":{"EQNum":"EQ2021-020","InspecDate":"2021-04-21T16:00:00.000Z","PtStatus":"Unstable"}}]}]

The console returns the 5 results I am looking for/know should be returned. I was unsure if this was happening because of the included geometry, so I removed that and tested again with the same result (console showing 5 features, but empty dictionary.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

XanderBakker — Fri, 07 May 2021 16:29:35 GMT

Hi @erica_poisson ,

In the returned json I notice that the geometry also contains the spatial reference for each feature. I am not sure if this may be causing any conflict.

"spatialReference": { "latestWkid": 3857, "wkid": 102100 }

We can change the expression and exclude that part and see what happens. I must admit that in the past I have had situations where a correctly formed JSON is created and an empty feature set is returned. Not sure if we are running into a restriction here.

One thing we can try is this:

// settings var p = 'https://www.arcgis.com'; var itemID_CMpts = 'xxx'; var layerID_CMpts = 0; var relationshipName = ""; // access first featureset var fs1 = Filter(FeatureSetByPortalItem(Portal(p), itemID_CMpts, layerID_CMpts, ['Point_Status', 'EQ_File_Number', 'Inspection_Date'], true), "Point_Status ='Unstable' AND EQ_File_Number In ('EQ2015-078', 'Eq2013-026', 'EQ2018-082', 'EQ2018-052', 'EQ2001-080X', 'EQ2003-021', 'EQ1989-015', 'EQ2002-023', 'EQ2002-045X', 'EQ2019-110', 'EQ2020-017', 'EQ2019-091', 'EQ2018-029', 'EQ2020-033', 'EQ2019-036', 'EQ2020-052', 'EQ2019-064', 'EQ2017-040', 'EQ2020-031', 'EQ2021-003', 'EQ2011-016', 'EQ2017-026', 'EQ2021-020')"); // create data schema var Dict = { 'fields': [ {'name': 'EQNum', 'type': 'esriFieldTypeString'}, {'name': 'InspecDate', 'type': 'esriFieldTypeDate'}, {'name': 'PtStatus', 'type': 'esriFieldTypeString'}], 'geometryType': 'esriGeometryPoint', 'features':[]}; // analysis and fill Dict var i = 0; for (var f in fs1) { var fs2 = FeatureSetByRelationshipName(f, relationshipName, ['Point_Status_revisit'], false); var cnt = Count(fs2); if (cnt == 0) { Dict.features[i] = { 'geometry': { 'x': Geometry(f)["X"], 'y': Geometry(f)["Y"] }, 'attributes': { 'EQNum': f["EQ_File_Number"], 'InspecDate': f["Inspection_Date"], 'PtStatus': f["Point_Status"] } }; i++; } } Console(Text(Dict)); return FeatureSet(Text(Dict));

Please share back what is returned in the console.

Re: ArcGIS Dashboard Data Expression, "unable to execute Arcade script"

erica_poisson — Fri, 07 May 2021 16:51:12 GMT

So with this example, I see (what looks like) the same result in the console, minus spatial reference info:

Use Console Function to output messages. {"fields":[{"name":"EQNum","type":"esriFieldTypeString"},{"name":"InspecDate","type":"esriFieldTypeDate"},{"name":"PtStatus","type":"esriFieldTypeString"}],"geometryType":"esriGeometryPoint","features":[{"geometry":{"x":-7997522.018099999,"y":5207172.07},"attributes":{"EQNum":"EQ2013-026","InspecDate":"2020-07-29T16:00:00.000Z","PtStatus":"Unstable"}},{"geometry":{"x":-7997970.5297,"y":5214400.591300003},"attributes":{"EQNum":"EQ1989-015","InspecDate":"2020-09-30T16:00:00.000Z","PtStatus":"Unstable"}},{"geometry":{"x":-7993994.632999999,"y":5212258.8379999995},"attributes":{"EQNum":"EQ2020-052","InspecDate":"2020-10-19T16:00:00.000Z","PtStatus":"Unstable"}},{"geometry":{"x":-8002495.5656,"y":5219019.943500005},"attributes":{"EQNum":"EQ2017-040","InspecDate":"2020-11-23T17:00:00.000Z","PtStatus":"Unstable"}},{"geometry":{"x":-7998590.2183,"y":5226627.4831000045},"attributes":{"EQNum":"EQ2021-020","InspecDate":"2021-04-21T16:00:00.000Z","PtStatus":"Unstable"}}]}