Data Translation Tools Preview

Discussion created by avezina-esristaff Employee on Jul 8, 2019
Latest reply on Jul 29, 2019 by avezina-esristaff

The Data Translation Tools are now available for preview, we anticipate a Q3 2019 release.

The latest version is 0.6.


The Data Translation Tools are a series of optimized tools for migrating data from a source dataset to a target dataset with a different data structure. They include predefined methods to automatically populate attributes. For example, these tools can help you streamline the process of data migration with translation into a utility network asset package and from there, to a utility network.


The toolbox is easily installed using the Anaconda Cloud and adds a new system toolbox in the Geoprocessing pane in ArcGIS Pro.


The tools help you:

  • Map source to target classes
  • Map source fields to target fields
  • Translate coded value domains codes



The following are some benefits of using the Data Translation tools:

  • Simplify the migration process with a collection of Excel workbooks
  • Ability to map and migrate your data a step at a time
  • Workbooks provide a record of source-to-target mapping which can be tracked and updated iteratively as needed


A quick tour of the Data Translation tools

The tools include…

  • Data manipulation tools for creating association records and to modify terminal connections.
  • Create Mapping Workbook: Creates a set of Excel workbooks that are used to map source dataset(s) to target dataset(s).
  • Load Data from Workbook: Loads data based on mapping created in workbooks.
  • Load with Transformation: Loads data based on mapping created in workbooks with the ability to include python snippets.


Get started with the Data Translation tools
Follow the steps below to get started with the tools:


1. System requirements

Before you begin working with the ETL tools, the following software is required:

  • ArcGIS Pro 2.4 (Standard or Advanced)

2. Install the ETL tools

To install the toolset, follow the steps below:

 Create a new environment

  1. Start ArcGIS Pro and create or open a project.
  2. On the Project tab, click Python to access the  Python Package Manager.
  3. Under Project Environment, click Manage Environments.
  4. Click Clone Default to clone your default environment.
  5. Click the Active button for the new environment, and click OK.
  6. Close ArcGIS Pro to allow your environment changes to take effect.


Install using the Python Command Prompt

  1. In the Windows Start menu, browse to the ArcGIS folder.
  2. Click the drop-down arrow next to ArcGIS and click Python Command Prompt to open the window. Alternatively, you can type Python Command Prompt into the Windows Start menu to open the Python Command Prompt window.
  3. Verify the first line of code displays the name of your cloned environment before continuing.
  4. Once confirmed, type conda install -c solutionsdev/label/pro2.4 etlsolutions and press Enter.
  5. You'll be prompted to proceed. Type y and hit Enter.
  6. Once installed, open ArcGIS Pro, open the Geoprocessing pane, and verify the Data Translation toolbox is visible.


Note: the Data manipulation toolset will only be available if you've installed the untools.


See more information on How to use the Data Translation Tools.