topic Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder in ModelBuilder Questions

Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

MDB_GIS — Tue, 16 Nov 2021 20:44:37 GMT

I am working on moving our GIS data from an old server to a new one. I've created the enterprise geodatabase on the new server, and have imported the schema from the old enterprise geodatabase from the old server. The new server now contains a bunch of empty template feature classes. I now need to figure out the best way to load or append all of the data from the old server into the new one. I have ~500 feature classes to do this for, so I'd prefer not to do it manually. I do not know python well enough to utilize it for this task, so I think my best option is to try and work something out with model builder. Any suggestions?

I'm running into a wall because I can't figure out how to tell model builder to append the data from the old server to the feature class that has the same name on the new server. I feel like I'm missing something with the iterators but I can't quite piece it together.

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Tue, 16 Nov 2021 20:51:22 GMT

You need to do an iterator and then use the %Name% field to find the input for the append tool.

I think a good approach to getting started is to use an iterator with the Calculate Value tool to generate the paths you need, when you get that working, you can feed those paths to the append tool.

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

MDB_GIS — Tue, 16 Nov 2021 21:20:46 GMT

Could you expand on the calculate value tool? Here is what I have so far:

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Tue, 16 Nov 2021 21:30:14 GMT

I would delete the append tool for now and use the Calculate Value tool with an expression like this to generate the output path:

output\enterprise\geodatabasepath\%Name%

Then run the iterator model and see if the output paths are correct. If they look good, add the Append back and connect that Calculate Value output (set its data type to feature class in the CV tool first) to the Append tool as an input.

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

MDB_GIS — Tue, 16 Nov 2021 21:40:20 GMT

I'm sure I did something wrong, but I added the calculate value with the following parameters:

When I ran just that portion of the tool, I got the following Error message:

ERROR 000539: File "<expression>", line 1
C:\Users\mbeal\AppData\Roaming\Esri\ArcGISPro\Favorites\FeatureClass
^
SyntaxError: invalid syntax
Failed to execute (Calculate Value).

Full model so far:

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Wed, 17 Nov 2021 04:35:12 GMT

Here's my attempt at a workflow for you, which I set up using file geodatabases; should work the same with Enterprise if the paths are correct. The tricky part is that Calculate Value expression is (a) a Python string expression and (b) the "r" is a raw string to protect the backslashes.

Run this thing and if the paths look right, add the Append tool to the model, connecting the two feature class variables (old and new) to the append tool.

The preconditions both document what you are doing and also make sure that the model variables used within the Calculate Value expression are up to date during each iteration.

Hope this helps you out!

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

MDB_GIS — Wed, 17 Nov 2021 14:52:54 GMT

This is extremely helpful. I was able to get it to recreate the correct file path using this setup. When I add the append tool, however, I get a new series of errors:

ERROR 000622: Failed to execute (Append). Parameters are not valid.
ERROR 002948: The shape type of C:\Users\mbeal\AppData\Roaming\Esri\ArcGISPro\Favorites\OCGIS21_Vector - GISadmin.sde\OCGIS_2020.DBO.OconeeSoils_March20201 is not the same as that of previously entered datasets.
ERROR 000229: Cannot open C:\Users\mbeal\AppData\Roaming\Esri\ArcGISPro\Favorites\OCGIS21_Vector - GISadmin.sde\OCGIS_2020.DBO.OconeeSoils_March20201
Failed to execute (Append).

The parameters that I have used for the Append tool are as follows:

Could it be the feature datasets in the EGDB throwing it off?

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Wed, 17 Nov 2021 15:32:28 GMT

I would try to run the append command manually first. If the inputs paths are correct this is not a ModelBuilder problem.

Feature datasets could possibly mess with the path issue (requiring more complex logic for your Calculate Value expression) but you said the paths were correct.

Wondering about your "Favorites" paths - have the EGDBs been added to the project? I don't know if that matters or not.

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

MDB_GIS — Wed, 17 Nov 2021 15:58:20 GMT

Actually I was wrong. Upon looking closely, it is the feature dataset. It is not being included in the the file path. It is just using the database name and then the feature class. Completely skipping the feature dataset. Any ideas on how I could force it to include that as well?

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Wed, 17 Nov 2021 16:04:37 GMT

Try the Parse Path tool to manipulate the Feature Class pathname. Then include that variable (containing the feature class name) in your output path. You'll need to use it twice, first to pull out the full path to the feature dataset, a second run to strip out the feature dataset name.

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

MDB_GIS — Wed, 17 Nov 2021 18:28:12 GMT

Ok. So I think that I am getting somewhere. Here is what I have now.

When I run that, the results window displays the following:

The part in red is the full path, which is correct. The feature dataset is OCGIS_2020.DBO.CadastralReference and the feature class is OCGIS_2020.DBO.GeorgiaMilitiaDistricts.

You mentioned that I would need to Parse the path twice. What would the input for the 2nd parse tool be? From there, what would I need to feed into the Append tool?

Additionally, thank you so much for all of your help and patience. I really appreciate it!

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Wed, 17 Nov 2021 18:50:43 GMT

Example:

First parse path: input: C:\test.gdb\fds\fc output:c:\testgdb\fds
Second parse path input: C:\Testgdb\fds output: fds

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Wed, 17 Nov 2021 20:44:06 GMT

The input SDE path above is

C:\Users\mbeal\AppData\Roaming\ESRI\ArcGISPro\Favorites\OCGIS_2020.DBO.CadastralReference\OCGIS_2020.DBO.GeorgiaMilitiaDistricts

The Calculate Value expression I'm using above is:

r"%name (2)%.%Extension (2)%"

which when executed becomes

OCGIS_2020.DBO.CadastralReference

After this you would use Calculate Value like before to assemble the pieces of your path, when it is correct you can use it for Append as you were before, except the path will be correct.

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

MDB_GIS — Wed, 17 Nov 2021 21:03:29 GMT

So would this need to be a sub-model? Wouldn't I need to iterate the process so that it loops through each feature class in the enterprise geodatabase?

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Wed, 17 Nov 2021 21:04:43 GMT

Nope

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

MDB_GIS — Wed, 17 Nov 2021 21:07:57 GMT

Hmmm. I will give this a shot in the morning and keep you posted. Thank you for your help again!

Re: Help appending all of the feature classes in one enterprise database to a template enterprise geodatabase using model builder

curtvprice — Thu, 18 Nov 2021 00:13:30 GMT

Sorry, I was in lab and didn't want you to go down that rabbit-hole. 🙂 If you check the Recursive box in the iterate feature class tool, it will iterate through a list of all the feature classes in the geodatabase, the paths will include the full paths which can then parse using the approach I suggested. One iterator should cover all the feature classes in the geodatabase this way, no need for a complicated nested iterator in a submodel.