topic Re: sid to geoTiff tiles in Imagery and Remote Sensing Questions

sid to geoTiff tiles

forestknutsen1 — Thu, 06 Nov 2014 06:20:03 GMT

I have two sid files, around 25GB, that I need to process. I need in the end geoTiff tiles (1GB in size would be fine) of a sub area defined by a polygon. And I need to preserve the data quality.

I have tried extract by mask, thinking that I could cut the sid down with the polygon to make the file size smaller, but it did not make an output after an hour of running even with a relatively small polygon mask.

Next I looked at LizardTech's tools here:

http://www.lizardtech.com/downloads/category/#tools__utilities

I ran the command "mrsidgeodecode -wf -i input.sid -o output.tiff" on a 1GB sid, I downloaded for testing, and it failed.

What is the best way to do this?

Re: sid to geoTiff tiles

JakeSkinner — Thu, 06 Nov 2014 12:15:35 GMT

Hi Forest,

Is the SID 25 GBs on disk, or is this the uncompressed size of the SID? You can check the uncompressed size by right-clicking on the SID in ArcMap > Properties > Source tab. When converting a SID to another format, such as TIF, the image will become uncompressed, so you may be creating a much larger raster than you think.

One way to see the output size of the raster you are creating is to zoom in to the area you would like to export > right-click on the SID > Data > Export Data. Choose 'Data Frame' under extent and below you should see the new uncompressed size.

Re: sid to geoTiff tiles

forestknutsen1 — Thu, 06 Nov 2014 17:17:14 GMT

Hi Jake,

Thanks for taking the time to reply. The sid sizes are 19.21GB and 28.79GB. I have tiff tiles for the other imagery years and after I have clipped them to the area of interest the output directory has been between 35GB and 45GB so I would image that the clipped output of the sids should be about the same if not smaller (the cell size for the year in quetion is only 2x2 vs 1x1 for the other years). The cell size of the provided sids and tiff are both the same in the tiffs and sids for these years.

What would your suggestion be to demosaicing them. Maybe just an export in arc?

Re: sid to geoTiff tiles

JakeSkinner — Thu, 06 Nov 2014 17:36:27 GMT

When you say the SIDs are 19.21GB and 28.79GB, is that the size on disk or the uncompressed size?

What is the purpose of clipping these rasters? How are you looking to use the clipped result? There may be another solution other than clipping imagery.

Re: sid to geoTiff tiles

forestknutsen1 — Thu, 06 Nov 2014 18:13:37 GMT

That is uncompressed size from the properties in ArcCatalog - looks like the size on disk is a little less then a gigabyte per sid.

We are doing a data share and we can only release imagery in the area of interest.

We want to share GeoTiffs so that the consumer of the data can import them into a CAD package.

Re: sid to geoTiff tiles

JakeSkinner — Thu, 06 Nov 2014 18:35:13 GMT

I would try performing the extract by zooming to the area of interest and then right-clicking on the SID > Export Data > choose 'Data Frame' for the extent. This will provide how much data on disk is required.

Re: sid to geoTiff tiles

forestknutsen1 — Thu, 06 Nov 2014 18:42:40 GMT

The size is the same for the one I checked - 28.79GB.

Re: sid to geoTiff tiles

JakeSkinner — Fri, 07 Nov 2014 11:33:44 GMT

How are you sharing the data? It may be a little difficult to share a 28 GB TIFF image.

Re: sid to geoTiff tiles

forestknutsen1 — Fri, 07 Nov 2014 18:20:36 GMT

Yes, we have an FTP site set up for that part - the whole share size will be something like 200GB.

I did try an export raster from arc and got a washed out looking tiff.

Looks like the LizardTech's tools did work fine on one of the sid files. No idea why it was failing on the sample sid I had. Who knows maybe it was old or corrupt in some way. Don't look a gift horse in the mouth. I exported one so now I have a tiff that is ~30GB.

I cut it up with the split raster tool which did make the tiff tiles ok - but the images in the tiles looks all washed out when done (looks the same as my esri export to tiff output)?? Why would this be happing? Other options for cutting it up into tiles?

Re: sid to geoTiff tiles

JakeSkinner — Fri, 07 Nov 2014 19:44:50 GMT

Can you send a screen shot of how the images are appearing?

Re: sid to geoTiff tiles

forestknutsen1 — Wed, 26 Nov 2014 18:36:13 GMT

No I can not as the image is not for the public. However I have solved the problem. Wrong pyramid build, lol.

Thanks for the help Jake

Re: sid to geoTiff tiles

TippinWilson — Tue, 14 Jun 2016 03:34:22 GMT

I am also having a similar issue. I have got a direct dump of imagery here on Fort Hood, however, they have given it to me in SID file's. For the life of me I cannot get the imagery to raster out to where I can see the imagery on Arcmap with my system. No where in the schoolbooks that I have do they tell me a certain tool to resolve this issue or anything either. Any help would be fantastic. I have tried searching for that mrsid tool, and it is nowhere to be found.

Re: sid to geoTiff tiles

Luke_Pinner — Tue, 14 Jun 2016 04:36:14 GMT

ArcGIS can read MrSID rasters natively, no extra software required (MrSID Gen 4. as of ArcGIS 10.1)

Have you tried adding them to ArcMap? What happens?

What version of ArcGIS are you using?

Re: sid to geoTiff tiles

DanPatterson_Retired — Tue, 14 Jun 2016 05:19:28 GMT

mrSid by lizardtech scroll way down Supported raster dataset file formats—Help | ArcGIS for Desktop in 10.4.1

ditto for Pro 1.2 Raster file formats—ArcGIS Pro | ArcGIS for Desktop

Re: sid to geoTiff tiles

TippinWilson — Tue, 14 Jun 2016 13:26:55 GMT

When I try to add the data, it won't even pull the imagery into the data viewer at all, it simply says "imagery does not have correct raster" or something along those lines. So I've been trying all of the rostering tools but I can not get the imagery to raster over.

Sent from my iPhone

Re: sid to geoTiff tiles

CodyBenkelman — Tue, 14 Jun 2016 15:10:34 GMT

It sounds like either your SID files are corrupted, or else there is something wrong with your installation of ArcGIS. I'm uploading a small MrSID file - try loading that into ArcMap and let us know if it works. If you have a colleague running ArcGIS, try your SID files on his/her system.

Re: sid to geoTiff tiles

TippinWilson — Tue, 14 Jun 2016 17:14:20 GMT

Unfortunately I don't. It's just me and our system with my unit. But I'll try it. Thank you.

Sent from my iPhone

Re: sid to geoTiff tiles

TippinWilson — Tue, 14 Jun 2016 22:38:06 GMT

So your SID file projected just fine, no rastering or exporting needed at all. Just a simple drag and drop. Not sure what's up with these files. Ill contact the office that gave them to me, I appreciate it.