-
Conectando URL al pipeline de datos
Estoy integrando la API de opengove a los pipelines de datos de ArcGIS y obtengo un error El pipeline de datos tiene parámetros inválidos, verifica errores de validación. Código de mensaje: ADP_102014 No estoy muy seguro de lo que significa este código. Si alguien ha conectado OpenGov y ArcGIS, por favor comparta sus…
-
Contacto alternativo para preguntas sobre funciones Beta durante el período de solo lectura de la comunidad
Hola a todos, Como habrán escuchado, Esri Community está en proceso de migrar a una nueva tecnología de plataforma. Pueden encontrar el anuncio aquí. Durante la migración, habrá un período en el que Esri Community estará disponible en modo solo lectura. Dado que esta comunidad es el foro principal para preguntas,…
-
Unique Identifier Not Found Issue
My output feature service has a field ADDRESS_ID which is unique. Yet the data pipeline is refusing to accept it as unique. So it Errors. * I've triple checked the Unique constraint is set in the service. It gave me no issue to set that as unique. * I ran Find Identical in ArcGIS Pro on the input and output service on…
-
Parquet Pre-set Symbology
I'm interested in serving up a statewide vegetation dataset, but would like to have pre-set symbology. It doesn't look like this is currently possible.
-
Parquet Drawing Time Improvement
I have a wall to wall 30-m vegetation raster dataset for California which has two fields I'd like to serve to the public via AGOL. One is a 13 class vegetation type, and the other a 62 class vegetation type. I've converted these to polygons (not simplified, kept as single part) and published as parquets, but I'm finding…
-
Support Enterprise Geodatabase Connections in ArcGIS Data Pipelines
It would be valuable for ArcGIS Data Pipelines in ArcGIS Enterprise to also support direct connections to enterprise geodatabases, such as PostgreSQL, Oracle, and SQL Server. This would allow organizations to build ETL workflows that connect directly to operational databases without needing intermediate export steps.
-
Add Preconditions to ArcGIS Data Pipelines
It would be valuable if ArcGIS Data Pipelines supported preconditions, similar to ModelBuilder in ArcGIS Pro. Preconditions would allow a tool to execute only after another tool has completed successfully or when a required condition has been met. This would provide better control over pipeline execution, simplify complex…
-
Enhance Date and Time Filtering in ArcGIS Data Pipelines
It would be helpful if tools in ArcGIS Data Pipelines that support Date field expressions provided more flexible relative date and time options. For example, users should be able to create expressions such as: * Current date/time - N days * Current date/time - N weeks * Current date/time - N months * Current date/time - N…
-
Add a Delete Rows Tool with Expression Support to ArcGIS Data Pipelines
It would be useful to have a Delete Rows tool that allows records to be deleted based on an expression. This would enable users to remove unwanted records directly within a pipeline without requiring additional filtering or workaround steps. Adding this capability would simplify ETL workflows, improve readability, and make…
-
Connect ArcGIS Data Pipelines to Enterprise Databases
I noticed that ArcGIS Data Pipelines currently supports direct connections to cloud data warehouses such as Google BigQuery and Snowflake. Is there a roadmap or estimated timeline for ArcGIS Data Pipelines in ArcGIS Enterprise to support direct connections to enterprise databases such as PostgreSQL, Oracle, SQL Server, and…
-
Support GeoParquet 2.0
I would like ArcGIS Data Pipelines to support reading GeoParquet 2.0 files and recognize Geometry and Geography columns as native spatial data types throughout the pipeline. Specifically, it would be beneficial if Data Pipelines could: * Read datasets that conform to the GeoParquet 2.0 specification. * Preserve CRS and…
-
Support GeoParquet Files in the ArcGIS Data Pipelines File Upload Source
ArcGIS Data Pipelines currently supports GeoParquet files when using the File Share source, but the File upload source only accepts standard Parquet files and does not allow GeoParquet files to be uploaded. It would be great if the File upload source also supported GeoParquet (.parquet) files and automatically recognized…
-
Remove the Default Data Pipelines Setting of Text Field = 4000 Characters
I am the Manager of Spatial Analytics on the Enterprise GIS Team for a conservation non-profit. We lean on Pipelines to bring data in from Snowflake. When creating or overwriting a feature layer using ArcGIS Data Pipelines, there is a setting hidden in the "Additional Settings" that sets the default text field length to…
-
Sharepoint List Connector
This idea is to use Data Pipelines to connect to MS List/SharePoint List data and sync that data to an AGOL table or Portal table. The SharePoint List has useful functionality like Active Directory people columns. So, we'd use the List for what it's good at in the Microsoft ecosystem, and then consume that data in AGOL or…
-
Native Support for ParquetLayer in 3D SceneView
While the introduction of the ParquetLayer has greatly optimized client-side streaming of columnar spatial data, its utilization is constrained strictly to 2D MapView environments. Attempting to mount a valid, OGC-compliant GeoParquet dataset into a 3D SceneView breaks the application lifecycle, throwing the following…
-
Can ArcGIS Enterprise Data Pipelines Server update an ArcGIS Online feature layer?
I have added a feature layer from ArcGIS Online to ArcGIS Portal with stored credentials and am trying to use it in as an output in Data Pipelines Server with the Add and Update option. When I run the pipeline, I receive this error: "This item does not exist or is inaccessible" Does Data Pipelines Server only work with…
-
Add a Flip Coordinates Tool to ArcGIS Data Pipelines
I suggest adding a Flip Coordinates transformation tool to ArcGIS Data Pipelines. Datasets from any source—including published feature layers, databases, APIs, and other spatial data—can sometimes have their coordinate order reversed (X/Y instead of Y/X). Correcting this currently requires additional processing outside the…
-
Add ClickHouse Database Support to ArcGIS Data Pipelines
Hello team, It would be great to see support for ClickHouse as a database connection in ArcGIS Data Pipelines. As ClickHouse adoption continues to grow, a native connector would benefit many data engineering and GIS workflows by enabling direct access to ClickHouse data. Thanks & Kind Regards
-
Add GML Geometry to Geometry Field in Create geometry tool
Hi team, Could we add WFS services' GML Geometry into the supported format of the geometry field for the Create geometry tool? A lot of our customers are still using WFS layers, and since they update those layers regularly, it would decrease their repetitive workload if we could create geometry directly from WFS layers in…
-
Additional Tool Options - Field Sorter / Attribute Mangement
The rollout of Data Pipelines has been very much welcomed, especially for as I've spent my years looking at FME in a desktop environment, however, I feel there's a few things that would be super useful. Please excuse the spam, as I will list within separate posts. - whilst we can map fields to an existing hosted layer or…
-
Additional Tool Options - Sort Feature
The rollout of Data Pipelines has been very much welcomed, especially for as I've spent my years looking at FME in a desktop environment, however, I feel there's a few things that would be super useful. Please excuse the spam, as I will list within separate posts. - Typical Sort Features by tool, being able to select a…
-
Additional Output Options - CSV
The rollout of Data Pipelines has been very much welcomed, especially for as I've spent my years looking at FME in a desktop environment, however, I feel there's a few things that would be super useful. Please excuse the spam, as I will list within separate posts. - Whilst creating either a hosted feature layer or table is…
-
Increase 900 category limit on AGOL
To manage our project files effectively in the absence of bulk tagging, we utilise ArcGIS Online categories. However, we recently reached the platform's limit of 900 categories. Given the scale of our work, we suspect other organizations may encounter this same bottleneck as their data libraries grow.
-
Call Power Automate flow from an Enterprise Data Pipeline to send an email
It would be great if we could call a Power Automate flow from an ArcGIS Data Pipeline in ArcGIS Enterprise. For example, a daily pipeline job to query if there are any construction projects in an EGDB FC where the PROJECT_STATUS=FUTURE and the DATE <= sysdate. If any records are found, then call a Power Automate flow to…
-
Send configurable email notifications from ArcGIS Enterprise Data Pipeline
I want to use ArcGIS Enterprise Data Pipelines to query EGDB records that meet certain criteria and email users if any records are found. In this case, I don't want to use a third-party platform for email, like Power Automate, because that kind of integration is more fragile than staying within a single product like…
