topic Re: Copy features a number of times based on a numeric field value in Geoprocessing Questions

Copy features a number of times based on a numeric field value

SethPaine1 — Tue, 30 Dec 2014 18:05:52 GMT

I have a point feature class with a Count field. I want to copy each feature in the feature class a number of times based on the number in the Count field. For example, if a feature has a Count value of 6, I want six new features created with all the same attributes as the original feature.

All the iteration model tools I can find want to group features based on an attribute value, but I want the number of iterations to be equal to the numeric value in my Count field.

Thanks

Re: Copy features a number of times based on a numeric field value

XanderBakker — Sat, 11 Dec 2021 06:53:39 GMT

You could use some python to do this:

def main():
    import arcpy
    import os

    fc_in = r"C:\Forum\DistLinePol\test.gdb\Points" # this one exists
    fld_count = "Count"
    fc_out = r"C:\Forum\DistLinePol\test.gdb\Points_out" # this one will be created

    # create the empty output featureclass
    path, name = os.path.split(fc_out)
    arcpy.CreateFeatureclass_management(path, name, "POINT", fc_in, "SAME_AS_TEMPLATE", "SAME_AS_TEMPLATE", fc_in)

    # insert the features into the output fc
    with arcpy.da.SearchCursor(fc_in, '*') as curs_in:
        flds_in = curs_in.fields
        idx_cnt = flds_in.index(fld_count)
        with arcpy.da.InsertCursor(fc_out, '*') as curs_out:
            for row in curs_in:
                cnt = row[idx_cnt]
                for i in range(0, cnt):
                    curs_out.insertRow(row)

if __name__ == '__main__':
    main()

This code can be transformed in a tool that you can use in a model...

Re: Copy features a number of times based on a numeric field value

BruceHarold — Wed, 31 Dec 2014 16:56:20 GMT

The Data Interoperability extension has a Cloner transformer for this task, if you want a zero-coding approach.

It is an interesting problem, you're going to end up with coincident points, what is the geoprocessing task you're tackling?

Regards

Re: Copy features a number of times based on a numeric field value

SethPaine1 — Wed, 31 Dec 2014 17:20:20 GMT

HI,

I want to get the average distance of a set of points from the start of a route. However, my point feature class has points that represent multiple records. In this case, the each point may represent many salmon redds (spawning beds). I want to know average location of spawning beds per year along a river route, but since each point represents multiple beds, calculating the mean distance of the points along the route under-represents points with multiple beds.

Therefore, if I can generate a feature class where each point represents an individual spawning bed, I can then calculate mean distance along the route.

Cheers,

Re: Copy features a number of times based on a numeric field value

SethPaine1 — Wed, 31 Dec 2014 17:45:50 GMT

I did develop a terribly tedious work around (I am not skilled in python). I first exported my points to a personal geodatabase. Then, using Access, I followed the process I found here within the personal geodatabase:

Creating duplicate rows - microsoft.public.access.queries

I created a table [tblNums] with a single numeric field [Num] and values from 1 to the maximum quantity (1-102 in my case).

Then I created a a make-table query of my current table and tblNums (do not link the two tables). I set the criteria

under the [Num] field to:

<=[Count]

This created a number of duplicate records for each original record equal to the number in my original Count field.

I then imported the table into ArcMap, and exported as a new table to give it an OID field. Then I took my original point feature class and populated two coordinate fields. Next I joined my original feature class point data table to my new table with replicas (based on a Unique ID). I then created two coordinate fields in my new table and copied the coordinates from the origin table. Then I removed the Join. Lastly, I projected my new table with duplicates based on the coordinate data.

It did work, and now I have my original point data with duplicate overlaying features based on the number in my count field. But I wouldn't want to incorporate this process into a regular work flow.

Re: Copy features a number of times based on a numeric field value

XanderBakker — Thu, 01 Jan 2015 07:13:54 GMT

I guess the code I provided earlier represents a slightly simpler way to duplicate the points...

Re: Copy features a number of times based on a numeric field value

SethPaine1 — Wed, 07 Jan 2015 18:51:21 GMT

Hi, I was trying that script and returned this error:

Traceback (most recent call last):

File "C:\Python27\ArcGIS10.2\Lib\site-packages\pythonwin\pywin\framework\scriptutils.py", line 326, in RunScript

exec codeObject in __main__.__dict__

File "D:\ArcGIS Tools\CreateDuplicateRecordsOnCountField.py", line 28, in <module>

main()

File "D:\ArcGIS Tools\CreateDuplicateRecordsOnCountField.py", line 14, in main

arcpy.CreateFeatureclass_management(path, name, "POINT", fc_in, "SAME_AS_TEMPLATE", "SAME_AS_TEMPLATE", fc_in)

File "C:\Program Files (x86)\ArcGIS\Desktop10.2\arcpy\arcpy\management.py", line 1800, in CreateFeatureclass

raise e

ExecuteError: ERROR 000622: Failed to execute (Create Feature Class). Parameters are not valid.

ERROR 000628: Cannot set input into parameter spatial_reference.

Any ideas on how to solve this?

Thanks!

Re: Copy features a number of times based on a numeric field value

XanderBakker — Wed, 07 Jan 2015 18:55:38 GMT

When it creates the output featureclass it is taking the input featureclass as the spatial reference. The error indicates that the featureclass is not valid to extract the spatial reference from. What did you specify as input featureclass? Does it have a spatial reference (=coordinate system)?

Re: Copy features a number of times based on a numeric field value

SethPaine1 — Wed, 07 Jan 2015 18:58:36 GMT

Yes, the input is projected in NAD_1983_UTM_Zone_10N

Re: Copy features a number of times based on a numeric field value

XanderBakker — Sat, 11 Dec 2021 06:53:42 GMT

weird...

... and what if you try this:

def main():
    import arcpy
    import os
    fc_in = r"C:\Forum\DistLinePol\test.gdb\Points" # this one exists
    fld_count = "Count"
    fc_out = r"C:\Forum\DistLinePol\test.gdb\Points_out" # this one will be created
    sr = arcpy.Describe(fc_in).spatialReference

    # create the empty output featureclass
    path, name = os.path.split(fc_out)
    arcpy.CreateFeatureclass_management(path, name, "POINT", fc_in, "SAME_AS_TEMPLATE", "SAME_AS_TEMPLATE", sr)

    # insert the features into the output fc
    with arcpy.da.SearchCursor(fc_in, '*') as curs_in:
        flds_in = curs_in.fields
        idx_cnt = flds_in.index(fld_count)
        with arcpy.da.InsertCursor(fc_out, '*') as curs_out:
            for row in curs_in:
                cnt = row[idx_cnt]
                for i in range(0, cnt):
                    curs_out.insertRow(row)

if __name__ == '__main__':
    main()

Re: Copy features a number of times based on a numeric field value

SethPaine1 — Wed, 07 Jan 2015 19:14:35 GMT

That did the trick. Thank you! Much appreciated.

Re: Copy features a number of times based on a numeric field value

XanderBakker — Wed, 07 Jan 2015 19:56:09 GMT

You're welcome. Glad it worked!

Re: Copy features a number of times based on a numeric field value

SethPaine1 — Thu, 08 Jan 2015 16:29:10 GMT

As you suggested, I made a toolbox tool from the script and it works perfectly for points. A funny thing happens when I try it with polygons though (after changing the feature type to POLYGON in the script). It seems to work and produces a polygon layer, complete with a table representing the duplicated features. But the polygons will not draw. If I zoom to the full extent of the feature class, it zooms to the world, but if I zoom to any particular feature, the extent does not move at all. I don't really need this tool for polygons right now, but am curious as to that particular behavior.

PS, what do you normally work on with GIS? Any tips for learning python without taking expensive ESRI classes?

Cheers,

Seth

Re: Copy features a number of times based on a numeric field value

XanderBakker — Thu, 08 Jan 2015 23:47:23 GMT

There are so many resources on the Internet that can help you to learn Python, it is to much to mention.

One way is to do a search in GeoNet: https://community.esri.com/search.jspa?q=learn+python or just Google it.

You will find a large number of post with lots of like to different sites like:

Dive Into Python

Learn Python

If you are willing to pay for a book, then this post references a very good book:

Re: Any Good Python Books

I have posted some Python Snippets that might help:

Some Python Snippets

Re: Copy features a number of times based on a numeric field value

EthanDuke — Sun, 11 Feb 2018 23:22:42 GMT

Seth, I'm trying to accomplish this as well (with points only), but I'm not very skilled in scripts. I also tried the data interoperability tool mentioned and failed. I've spent more time trying to do this than I care to mention and for several years I have been manually doing this for tens of thousands of features (bird detections). This sure would be a game changer for me and our little NGO. I've tried several times with the python provided, but I couldn't overcome the errors. I know it has been a while, but could you share the modelbuilder with me or let me know how you accomplished this?

Thanks!

Ethan

Re: Copy features a number of times based on a numeric field value

XanderBakker — Mon, 12 Feb 2018 11:22:49 GMT

If it is a process that you will repeat, it might be good to create a tool from the script. Can you provide a sample of your data and a brief explanation of which field contains the number a feature should be repeated? Also please provide the version of the software you have ArcMap or ArcGIS Pro. I will see if I can create the tool for you so you can run this more easily. Anyway, for other workflows it might come in handy to learn some python.

Re: Copy features a number of times based on a numeric field value

EthanDuke — Mon, 12 Feb 2018 15:02:41 GMT

Thanks for reaching out, Xander. I've provided a link to the data, here. The field containing the number for which each feature is to be repeated by is "Count_". All attributes need to remain the same. It would be great if the count field for the copied records was change to one, but that can be done easily enough after an otherwise successful script run. I'm using the latest version of ArcMap 10.5.0.6491. I hear you on the need to learn Python. I'm completely self-taught in GIS. It's been years of banging of my head against wall until I found solutions and workflows that would have been much easier to accomplish if I knew python. I've got my hands full running our small NGO that covers a lot of ground. I'll work on learning more from the resources mentioned above.

Re: Copy features a number of times based on a numeric field value

XanderBakker — Sat, 11 Dec 2021 06:53:45 GMT

Hi Ethan Duke ,

A small correction,the current version of ArcMap is 10.6 (10.6.0.8321). I just changed the code to create the tool and to do a test run. The updated code is:

def main():
    import arcpy
    import os

    # parameters of tool
    fc_in = arcpy.GetParameterAsText(0)
    fld_count = arcpy.GetParameterAsText(1)
    fc_out = arcpy.GetParameterAsText(2)

    # create the empty output featureclass
    arcpy.AddMessage("Create output featureclass...")
    sr = arcpy.Describe(fc_in).spatialReference
    shp_type = (str(arcpy.Describe(fc_in).shapeType)).upper()
    path, name = os.path.split(fc_out)
    arcpy.CreateFeatureclass_management(path, name, shp_type, fc_in, "SAME_AS_TEMPLATE", "SAME_AS_TEMPLATE", sr)

    # insert the features into the output fc
    cnt_feats = 0
    with arcpy.da.SearchCursor(fc_in, '*') as curs_in:
        flds_in = curs_in.fields
        idx_cnt = flds_in.index(fld_count)
        with arcpy.da.InsertCursor(fc_out, '*') as curs_out:
            for row in curs_in:
                cnt = row[idx_cnt]
                lst_row = list(row)
                lst_row[idx_cnt] = 1
                row_out = tuple(lst_row)
                for i in range(0, cnt):
                    cnt_feats += 1
                    if cnt_feats % 1000 == 0:
                        arcpy.AddMessage("Writing feature: {}".format(cnt_feats))
                    curs_out.insertRow(row_out)

    arcpy.AddMessage("Finished writing {} features...".format(cnt_feats))


if __name__ == '__main__':
    main()‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

The tool will look like this:

When I did some test runs the feature get duplicated based on the selected count field and the count field is reset to 1.

I did notice that your data has a GlobalID field. The problem with a GlobalID field is when write the the feature the GlobalID is changed in the output:

Do you have any attachments related to the points?

I can attach the toolbox, but possibly you won't be able to open it with ArcMap 10.5. I could create a 10.3 version at home which will be compatible with 10.5 that you have.

Re: Copy features a number of times based on a numeric field value

EthanDuke — Mon, 12 Feb 2018 16:55:53 GMT

Hi, xander_bakker,

This is great. I'm working remotely and will secure more robust internet and update ArcMap (within 48 hours). The attachments and/or GUID are not necessary with this particular feature class after this stage of the workflow. I will work on this ASAP with results. Thank you!!

Re: Copy features a number of times based on a numeric field value

XanderBakker — Mon, 12 Feb 2018 16:59:55 GMT

Hi Ethan Duke ,

I have attached the toolbox (10.6). If you have any problems upgrading to 10.6 or with the toolbox, just let me know and I see what I can do.

Kind regards, Xander