nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Publish a service directly from a Parquet file in ArcGIS Online

FredLott

I would like to be able to publish a hosted feature or table service directly from an Apache Parquet file item in ArcGIS Online. This would replicate similar functionality for other supported file types like CSV, zipped Shapefiles or File Geodatabases, etc. This would be especially efficient for tabular data and integrations with other data services. It would also reduce I/O, storage usage, and ensure data type preservation compared to something like CSV.

ArcGIS Online Data Pipelines already support creating or overwriting a hosted service from a Parquet file.

Ideally this would give Parquet files the same "publish" methods in something like the REST API or API for Python.

Finde mehr Beiträge mit dem Tag

Status: Öffnen

Kommentare

RussRoberts

This is supported in data pipelines. You can take that parquet file and publish a feature layer or the new parquet feature layer (beta). You can read about it here: https://www.esri.com/arcgis-blog/products/apps/announcements/whats-new-in-arcgis-data-pipelines-june-2026

FredLott

@RussRoberts I acknowledged that in the idea, and that is not is what the request is about. It's requesting the same functionality as other publishable files like when a CSV or zipped file GDB is uploaded. Only having it available via Data Pipelines doesn't offer the same level of flexibility in terms of content management or scripting that are available to users with all of the other publishable file formats.

JeremyBartley1

Hi Fred. In a future release we will support directly adding a parquet dataset to the portal as an item or published as a hosted feature layer without Data Pipelines. We are also adding the ability to export from feature layer to a parquet collection.

I do recommend checking out: https://www.esri.com/arcgis-blog/products/arcgis-online/announcements/scaling-your-gis-workflows-with-the-new-parquet-feature-layer-beta-in-arcgis-online

This post talks about the new Parquet Feature Layer. Within Data Pipelines you can publish any input dataset as the new Parquet Feature Layer. This workflow creates a Parquet Feature Layer item which stores the parquet files within the portal. These parquet files are spatially optimized for fast, web based visualization on datasets of any size. Initial support is in the Esri web apps, but will have support in Pro and Native apps in a future update.

We also plan on allowing you to create parquet feature layer items through the normal publishing workflow.

FredLott

Thanks, this looks promising! I see that Parquet Feature Layers require a Geometry field. I'm interested in using Parquet files to upload and publish non-spatial tabular data as well, so anything supporting that would be great.

Nehmen Sie an der Diskussion teil

Melden Sie sich an, um zu posten, Inhalte zu folgen und mehr. Neu hier? Kostenlos registrieren.