Data Loading Tools is now included with ArcGIS Pro - 3.2 and Beyond

[MikeMillerGIS]

Starting with ArcGIS Pro 3.2, the Data Loading Tools are now included with ArcGIS Pro. You no longer must clone your python environment and install the tools via Anaconda.  The tools are available in the Data Management Tools toolbox, under the Data Loading Tools toolset.

As we moved the tools into ArcGIS Pro, we made some modifications that are highlighted below:

Create Data Loading Workspace

Only the names of the parameters have changed.  No other tool changes.  There have been changes to the Data Loading Workspace, which are noted below.

Generate Predefined Mapping Table

This tool has been renamed to Generate Mapping Table and the names of the parameters have changed. 

Execute Data Load

This tool has been renamed to Load Data Using Workspace.  The names of the parameters have changed and the Preview option has been removed and replaced with Load Data to Preview tool.

Update Data Loading Workspace Schema

Only the names of the parameters have changed. 

Data Loading Workspace – Data Reference workbook

The DataPath worksheet has been removed.  The full paths are now used in the SourceTargetMapping worksheet

Data Loading Workspace – Mapping workbook

The help image has been removed from the -Info- sheet.  The yellow schema tabs have redesigned to follow the look and feel of the workbook generated with the Generate Schema Report tool.  They also now have a dash(-) in their names.

Data Loading Workspace – Domain workbook

All the domain, as well as the TOC sheet, in this workbook have also been reformatted to make the look and feel of the results from the Generate Schema Report tool.

Append with Transformation

Append with Transformation was removed due to some overlap with future plans for Append GP tool. We did not want to add it into Pro only to retire it soon after. However, the underlying logic for Append with Transformation is still there. Attached is a toolbox that works with ArcGIS Pro 3.2 and greater that provides the Append with Transformation GP Tool.

We are excited, and hope you are too, that these tools are now part of ArcGIS Pro out of the box and no longer require you creating a python clone.  This will speed up the time to use these tool and remove the complications with managing a cloned python environment.

Mike

ArcGIS Solutions

[MatteoMagnani_WT]

Good Morning everyone again,

We recently updated our AGP version to 3.3.
The Append with Transformation in a atbx toolbox that you gave us on 11-27-2023 does not work anymore.
Used in PyCharm, it returns this error:
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\1\\tmpx73hotps\\stage.gdb\\a0000000b.gdbtable'

Is it possible to have an upgraded version of the tool, compatible with AGP 3.3, while we wait that you insert the Appen with transformation functionality into the normal append tool?

Thanks in advance.

Best regards,

[TedHoward2]

The atbx should still be compatible in ArcGIS Pro 3.3. Does the same error occur when running the tool manually from Pro? It may help if post a code snippet of how you are calling into the tool from pycharm. I had success running the following:

arcpy.ImportToolbox(r"C:\temp\AppendWithTransformation.atbx")
arcpy.dlt.AppendWithTransformation(
    source=r"C:\temp\Source.gdb\source_table",
    target=r"C:\temp\Target.gdb\target_table",
    mapping=[("target_a", "add100(!source_a!)")],
    code_block="""def add100(x):
  return x + 100""",
    load_type="Target"
)

[MatteoMagnani_WT]

Goodmornig and thanks for your answer,
if I use the script tool directly in AGP, I do not have errors.
But, if I import the tool in Pycharm, as in your example, I get the error only when into the mapping i call a function present in code_block. If I don't call the function, the tool run witout error in Pycharme too.
I attach the error.
I hope you could help me.

[MikeMillerGIS]

I updated the post to include a new toolbox for 3.3 that resolves the issue.  Can you test it out?  

[MatteoMagnani_WT]

Good Morning Mike,

I tested the new version of the tool and it also works perfectly in PyCharm.

Thank you so much for the support.