Ad hoc Data Loading - Append with Transformation

1041
1
08-25-2020 08:22 AM
AlixVezina
Esri Regular Contributor
1 1 1,041

Access the Data Loading Tools documentation here: Data Loading Tools | ArcGIS Solutions 

 

If you are looking for an ad hoc data loading process or processing single datasets, you may only need the Append with Transformation tool. This tool allows you to directly map and load your data from the source to the target, without needing the mapping workbooks.


This leverages the Append geoprocessing tool from ArcGIS Pro, which you may already be familiar with, but allows for a more detailed field mapping and the use of complex Expressions.


For example, shown in the image below, I need to load the Water Main features from a layer in my map into the Water Line layer.

Append with Transformation geoprocessing tool in ArcGIS Pro


   1. In the Geoprocessing pane, click the Toolboxes tab and browse to the Data Loading Tools toolbox[1] to open the Append With Transformation tool.


   2. Specify the location of the source dataset.

Map layers can be used as source data and, if a layer has a selection, only the selected records (features or table rows) are used by the tool.


   3. Specify the location of the target dataset.

If there are common field names in both the source and target datasets, the tool will automatically match them.


   4. Specify the Target Field and Expression parameters under the Field Mapping section.

Optionally, use the Code Block parameter for multiline Python expressions and call it in the Expression parameter to run. In this example, the GlobalID values are automatically generated when the data is loaded into the target layer.


   5. Click Run to append your source data into your target dataset with the defined transformations.

 

If you need to load multiple datasets into a new dataset, you will need to create a data loading workspace with a set of workbooks that can be iterated as your process evolves. This allows you to have a record of your mapping information so that it can be fine-tuned or revisited as needed.

 

To learn more about source to target mapping using the data loading workspace, check out this video: Source to Target Mapping for Data Loading 

 

[1]  Set the Stage for Data Loading to install this toolbox in ArcGIS Pro.

1 Comment
About the Author
Alix Vézina is a senior product engineer on Esri's ArcGIS Solutions Web Development team, where she has successfully delivered industry web mapping tools since 2019. Her previous work includes assisting in the digital GIS transformation of a property and land-management organization in New Zealand and coauthoring ArcGIS learning resources for the Public Safety sector. In her free time, Alix enjoys hiking with her puppy in the Colorado foothills.