idea Filter database table (with sql) before import in ArcGIS Pro Ideas

Filter database table (with sql) before import

TorstenFay — Sat, 30 Mar 2024 04:27:54 GMT

When importing data from a sql-database via catalog pane, one has to load all data within the specified table. When using tables with data with complex shapes and several thousands of vertexes per entry, it takes minutes to even calculate the extent. After that one can exclude data that is not needed for the specific project.

It would be better if you could use sql-query to make a selection of entries that should be recognized and loaded in the first place.

Re: Filter database table (with sql) before import

AlfredBaldenweck — Thu, 14 Dec 2023 15:36:32 GMT

If using an enterprise GDB, you may want to check out Query Layers. Query layers—ArcGIS Pro | Documentation

Re: Filter database table (with sql) before import

Bud — Thu, 14 Dec 2023 16:29:08 GMT

As a temporary workaround, could you use a model? Use a SQL expression in the Select tool and use that as a direct input to the Import tool.

Also, I wonder if there are any GP tools similar to Import that have a SQL Expression parameter.

Re: Filter database table (with sql) before import

KoryKramer — Sun, 17 Dec 2023 14:41:00 GMT

@TorstenFay when you say importing data via catalog pane, are you using the Feature Class to Geodatabase tool?

XML Workspace Document?

Re: Filter database table (with sql) before import

TorstenFay — Tue, 19 Dec 2023 07:03:27 GMT

Hey, @KoryKramer, no, I just drag the database into my map.

Step 1:

Step 2:

Step 3:

This Step 3 can take a while. It would be nice if one could define a filter within Step 2.

Re: Filter database table (with sql) before import

AlfredBaldenweck — Tue, 19 Dec 2023 13:51:20 GMT

Wait.

Unless I'm missing something, why aren't you using a Where clause in that Query layer?

Re: Filter database table (with sql) before import

TorstenFay — Tue, 19 Dec 2023 14:31:21 GMT

Hi, @AlfredBaldenweck , you mean via Properties -> Source -> Query... but this is only possible after loading in the whole table. As far as I know...

Re: Filter database table (with sql) before import

AlfredBaldenweck — Tue, 19 Dec 2023 14:36:36 GMT

Nope, I think you have your order of operations wrong.

Re: Filter database table (with sql) before import

TorstenFay — Tue, 19 Dec 2023 14:51:00 GMT

Many thanks for the really good workaround. Obviously I was not aware of this way of importing.

So I really just need to change my workflow. Thanks!

Re: Filter database table (with sql) before import

Bud — Tue, 19 Dec 2023 15:12:36 GMT

@TorstenFay In the future, it might help to avoid using the word "import" in this context. Normally, importing would mean you are inserting data into a table or feature class using a geoprocessing tool. But when you add data to a map/create a query layer, you're simply viewing the data, not importing it into a table or feature class.