topic Re: Counter functionality in Data Pipelines Questions

Counter functionality

whw53 — Fri, 14 Jun 2024 14:49:54 GMT

I am trying to assign a new ID within pipelines using an interval so the first record is given a 'new_ID' of '1' , the next record is '2' , '3' andso on..

This is a simple ability in FME using the Counter transformer - has anyone been able to replicate this functionality in Data Pipelines? Using Arcade I can only reference the 'record' variable so this is limiting .

Re: Counter functionality

rob_hewy — Sun, 16 Jun 2024 18:55:02 GMT

The output of the pipeline is a feature layer that will have an objectid column starting at 1 and going up by one. Would that work?

Re: Counter functionality

whw53 — Wed, 19 Jun 2024 19:21:46 GMT

thanks Rob - i'm trying to update an ID column apart from the OBJECTID on an existing feature layer. I need to reference the maximum ID already present in the existing layer as well. In FME i would grab the maxID from an existing layer, unconditionally merge it onto my data moving through the etl, and then use the counter output to calculate a new ID by adding the max with the counterID. Couple things difficult here - counter, unconditional merge , taking max id of a dataset etc. tools are more limited.