topic Re: Create "Zip" file in Model Builder in ModelBuilder Questions

Create "Zip" file in Model Builder

Syvertson — Wed, 21 Jun 2023 13:09:25 GMT

I have a model builder process that will create a shapefile, that later is retrieved by another process. The other process requires a zip file input. Is there any way I can zip up these files within model builder?

Re: Create "Zip" file in Model Builder

ABishop — Thu, 09 Dec 2021 16:00:07 GMT

Hello Matthew,

I have a similar process but it is handled using a combination of a python script to prepare the data and then a batch file script to zip the contents of the folder. I can share it with you if you like.

Re: Create "Zip" file in Model Builder

curtvprice — Thu, 09 Dec 2021 16:05:35 GMT

You can do this using the Calculate Value tool, with a python function that uses glob and zipfile. You may want to run Parse Path first to get the info you need to create the zip (folder, shapefile root name).

Re: Create "Zip" file in Model Builder

curtvprice — Fri, 21 Jan 2022 17:57:07 GMT

UPDATE: added check to loop to avoid trying to write the zipfile into itself and causing an infinite loop (!) (discussed downthread)
UPDATE: this function requires the two inputs folder (path to the shapefile) and name (shapefilename, for example if your shapefile is foo.shp, the name should be foo (without the extension)

import os import glob import zipfile def zipshape(folder, name): os.chdir(folder) zipname = name + ".zip" with zipfile.ZipFile(zipname, "w") as newzip: for ff in glob.glob(name + ".*"): if ff[-4:] != "lock" and ff != zipname: newzip.write(ff) return os.path.join(folder,zipname)

Re: Create "Zip" file in Model Builder

Syvertson — Thu, 09 Dec 2021 21:55:35 GMT

I am not yet great at python, so simple is better. If I already know what the full path and shapefile name is always going to be, how would this look simplified?

Re: Create "Zip" file in Model Builder

ABishop — Thu, 09 Dec 2021 22:00:57 GMT

See below for the batch file script that I use to zip up the files. You will have to download 7Zip software to make it work. Put this in a text file in notepad and then save it as a .bat. I run it in Windows Task scheduler behind the script that prepares the text files.

:: Zip TxtFiles in DATA\TEXT folder
@echo ON

SET SourceDir=K:\GIS_UPDATE\DATA\TXT*.txt
SET DestDir=K:\GIS_UPDATE\DATA\TXT\MCPAEXTRACT.zip

CD /D "C:\Program Files\7-Zip"
7z.exe a "%DestDir%" "%SourceDir%"

Re: Create "Zip" file in Model Builder

curtvprice — Thu, 09 Dec 2021 23:08:56 GMT

Honestly I can't think of an simpler way to do this.

This is a plug and play python function, you don't need to edit it at all, just create a calculate value tool and paste the code in the code block, and make sure the variables (inside the %) match the model variables that have your folder and shapefile name. The function doesn't care as long as you give it the correct folder and shapefile root name, which is easily found with Parse Path. I suppose you could enter your folder and shapefile name directly in the Calculate Value tool expression in place the model variables...but Parse Path makes it pretty easy to avoid having to hard-code it.

Re: Create "Zip" file in Model Builder

Syvertson — Fri, 10 Dec 2021 14:01:08 GMT

OK. I will try it and let you know how it goes.

Re: Create "Zip" file in Model Builder

Syvertson — Fri, 10 Dec 2021 14:02:26 GMT

I want to stay in model builder, but if the other solution does not work, I will try this one. Thank you for your contribution. I am sure it will benefit someone, whether its me or another down the road.

Re: Create "Zip" file in Model Builder

ABishop — Fri, 10 Dec 2021 14:02:42 GMT

Let me know if you try my method. I have been doing this same workflow for over 3 years with no issues.

Re: Create "Zip" file in Model Builder

Syvertson — Fri, 10 Dec 2021 15:09:47 GMT

The process "calculate values" seems to have created the zip file just fine, but the model builder is stuck on the step. The zip file was created and has not changed file size for about 20 minutes. See screen shot:

I can't understand what would hang it up.

Re: Create "Zip" file in Model Builder

Syvertson — Fri, 10 Dec 2021 15:18:39 GMT

Update to this: I force killed the process through task manager, and the file size had grown huge, and it was an invalid file when I tried to open. See screen shot:

Re: Create "Zip" file in Model Builder

curtvprice — Fri, 10 Dec 2021 15:32:59 GMT

That's really weird as it worked for me - but my test model didn't create the shapefile, I gave it a path to an existing one. Too bad the zip isn't valid as I can't imagine what it was trying to stuff in there. Thanks for the really detailed screenshot, I will look at the puzzle.

Re: Create "Zip" file in Model Builder

curtvprice — Fri, 10 Dec 2021 15:43:48 GMT

I've got an an idea for a small code change, modify the code I posted, try changing

for ff in glob.glob(name + ".*"):

for ff in glob.glob(name + "*"):

Re: Create "Zip" file in Model Builder

Syvertson — Fri, 10 Dec 2021 15:38:53 GMT

OK. Maybe in this I can solve another problem. Can I specify a different folder for shapefile that needs to be zipped and the output zip location?

Re: Create "Zip" file in Model Builder

Syvertson — Fri, 10 Dec 2021 15:45:41 GMT

I attempted this change to: "for ff in glob.glob(name + "*"):"

and I had the same result.

Could this be stuffing the zipfile that it is creating into the zipfile that it is creating, creating a loop of sorts?

Re: Create "Zip" file in Model Builder

curtvprice — Fri, 10 Dec 2021 16:49:37 GMT

Improved, skipping the zip to avoid trying to write it into itself:

import os import glob import zipfile def zipshape(folder, name): os.chdir(folder) zipname = name + ".zip" flist = glob.glob(name + ".*") with zipfile.ZipFile(zipname, "w") as newzip: for ff in flist: if ff[-4:] != "lock" and ff != zipname: newzip.write(ff) return os.path.join(folder, zipname)

Re: Create "Zip" file in Model Builder

Syvertson — Fri, 10 Dec 2021 16:54:51 GMT

This worked perfectly. Thanks so much for helping me with this!

Re: Create "Zip" file in Model Builder

curtvprice — Fri, 10 Dec 2021 18:16:55 GMT

That's great! Could you mark the first (updated) post with the screenshot of the test model as the solution? I think the post with the ModelBuilder model would be most useful to people looking for an answer to this question.

Re: Create "Zip" file in Model Builder

ABishop — Fri, 10 Dec 2021 18:18:29 GMT

Good job!