|
POST
|
Tom You didn't say where you want to use the resulting output - if you're working in ArcGIS, by far the best solution will be to use a Mosaic Dataset which is intended for just this sort of scenario. See What is a mosaic dataset?—Help | ArcGIS Desktop (This has been available since 10.0 - features change depending on version but you presumably aren't on 9.x?) If you must eventually export this to a single mosaicked image in a file on disk, you can do that, but as Curtis noted you *will* see an increase in data volume. If you're only working within ArcGIS, you should be able to build a Mosaic Dataset of MANY source files in a matter of minutes, and use it immediately. If you have issues with some images not being visible when you zoom out, or with black "noData" from one image obscuring underlying images, be sure to Build Footprints and also Calculate Item Visibility for the mosaic. You may need to build Overviews which are reduced resolution views, but the SID files have built in pyramids that may fill that need. You may also want to review the downloadable script at (there's also sample data) at this link http://www.arcgis.com/home/group.html?id=b65f2601e0084e32afab3eb488fa8a67&q=preprocess&t=group&start=1 which includes a GP tool interface for building mosaics of SID files and automatically does the Build Footprints step. Look for the tool named Create Source Mosaic, and under Footprint, choose "Remove black edges around imagery"
... View more
04-21-2017
03:18 PM
|
1
|
1
|
3498
|
|
POST
|
To Mark and everyone: If you have everything you need, we don't need to prolong this conversation, but I'm a bit concerned that we're talking about specific details without a clear discussion of "the big picture". You haven't mentioned if this cache is being published on ArcGIS Online (or Portal), or if it's only for internal use on a LAN or via your own server, and I also don't know if this is a one-time project, or something you'll need to replicate and/or update repeatedly over time. Depending on your long term goals, size of cache, complexity of inputs, etc. our advice may be different. Presuming this is not a one-time project, you may want to download Cacheworx which is designed to analyze a tile cache to ensure there aren't missing tiles... See http://esriurl.com/CacheWorx Cody B
... View more
04-13-2017
09:47 AM
|
0
|
2
|
4616
|
|
POST
|
Mark You can drop the complete cache into ArcMap or ArcGIS Pro - in this screenshot it would be called "TestCacheAspectRGB". If you're navigating down into the subfolders and seeking to display individual bundles at different levels, I don't believe we have a method for viewing single bundles. If that's what you're seeking, let me know and I'll double check. Cody B.
... View more
04-06-2017
06:15 PM
|
1
|
3
|
5380
|
|
POST
|
Andrew there are some other resources that may be helpful to you. This blog Create rectangular features using their geographic extents | ArcGIS Blog references a tool for creating a feature class for the neatline of the map (vs. the collar) if you have or can create a table of appropriate metadata. There is also a tutorial available at http://esriurl.com/12218 including a link to the Quad-G software that can automatically identify the tic marks on a map. If you want to work through that tutorial, there is a project folder (with MXD, GDB, tools, metadata, etc.- 540 KB data volume) here http://esriurl.com/12216 and sample data here (5.4GB) http://esriurl.com/12217 Let us know if these do not represent the type of data you have... Cody B.
... View more
02-17-2017
01:57 PM
|
0
|
0
|
1062
|
|
POST
|
Andrew My apologies that this hasn't been addressed. We don't have a chapter in the Guidebook re: Scanned Maps, but there is a workflow script here http://www.arcgis.com/home/item.html?id=de75a7063b36420fa8dfabba220495f6 and sample data to go with the script here http://www.arcgis.com/home/item.html?id=4f03f5904a0743af971c8176327066e8 . Note that the workflow referenced in those scripts is based on having a table listing all of your scan files along with the geographic footprint (envelope) of each map. If you don't have such a table, the tool referenced in this blog Create rectangular features using their geographic extents | ArcGIS Blog can help you build it. If you have a specific project and need assistance, let us know and we'll do our best to support your needs. Cody B
... View more
02-14-2017
11:53 AM
|
0
|
0
|
1062
|
|
BLOG
|
Fabian what is the date of your Sentinel image? ESA changed the format (see this press release https://scihub.copernicus.eu/news/News00102 ), and satelite scenes written in the new format are not fully supported by ArcGIS, although you can still read and process the imagery. I am guessing you have a new format scene. Several points follow: I have not yet been able to verify the exact date of the format change; the press release says 27 September 2016, but I have seen other posts mentioning later dates. If anyone on GeoNet can confirm specifics, please add a reply. My comment about "fully supported" refers to the Raster Product (drag & drop the XML file into ArcMap) or ingesting into a Mosaic Dataset using the Sentinel 2 raster type. This support provides full metadata access and views each scene as a proper multispectral image. Satellite scenes in the original format are supported in ArcGIS 10.4, 10.4.1 and 10.5. The change to the new format came at a point within our software development cycle that prevented a modification from being implemented in our most recent version (10.5). Scenes in the newer format can be accessed in ArcMap if you go to the xxx\granule\scene_name\img_data folder and access individual spectra bands as separate JP2 files You may see references to an automated processing script at http://www.arcgis.com/home/item.html?id=e6e1f20cb0374d28a6eed24f5c2ff51b which was built to use the Sentinel 2 Raster Type. As a result, this script will work with the older format, but not the newer file format. Development is underway for support of the new format, but we don't have an availability date at this time. My ORIGINAL REPLY was 13 Jan 2017; UPDATE 17 Feb 2017: support for the metadata format after the change in Sept. 2016 will be included in ArcGIS 10.5.1. Until then, you can access individual bands as JP2 files (see 2 paragraphs back) Cody B.
... View more
01-13-2017
12:29 PM
|
2
|
0
|
22850
|
|
POST
|
Kushendra - there are no specific tools or "magic method" for removing shadows from extremely high resolution imagery within ArcGIS, but our Segmentation tools may be relatively effective at highlighting areas of shadow vs. non shadow, and allowing you to combine shaded areas into their appropriate groundcover class. (See these links to Help for Pro or ArcMap. What version are you using?) However, I think it is worth expanding this to discuss other issues. First, what resolution is your imagery? I'm assuming centimeters, but if you are flying high and capturing ~1 meter data, the workflow may be somewhat different. Second and critically important, what sensor are you using? If it is a Bayer array (single CCD sensor), the spectral content of the red band includes NIR energy that cannot be completely removed, so your NDVI values will be questionable. If you are using a multi-sensor camera like frpm Micasense, TetraCam, or a hyperspectral imager (e.g. from Resonon, you should be getting good quality spectral imagery. Third, how did you create your mosaic? If you are using a Mosaic Dataset and are rectifying each image "on the fly" into a virtual mosaic, you have not disrupted your original pixel values by resampling. Otherwise, if you have used Drone2Map, Pix4D, or similar software to create a single orthomosaic, your spectral values have already been modified by both multi-scene averaging and resampling such that an NDVI will be less accurate. (If you add this onto the Bayer array issue #2, I'd say your NDVI will be qualitative at best - not a highly accurate quantitative measurement). All together, my experience is that NDVI dramatically reduces the effects of shadow. Since the shadow diminishes the brightness value of both the NIR and Red bands, the ratio in the NDVI should not show a dramatic difference in shadowed vs. non-shadowed regions. e.g. you may want to review this paper: "An Analysis of Shadow Effects on Spectral Vegetation Indexes Using a Ground-Based Imaging Spectrometer" In fact, I have used NDVI specifically for the purpose of compensating for shadow. If your data seems to show dark shadows in the NDVI, I suspect your sensor is not providing good quality measurements in the two bands.
... View more
12-20-2016
09:49 AM
|
1
|
1
|
6214
|
|
POST
|
Forest As with so many questions, the simple (but not helpful) answer is "it depends". To be more helpful, I'll expand on some of the considerations - but as Dan indicated, you should test IDW vs. NaturalNeighbor on a small sample to see which will work best for you. In general IDW will leave you with a rougher DEM (although possibly more accurate), whereas NatNeighbor will be smoother - but there are other considerations: Do your XYZ files have values at every XY location, or are there gaps? (and are the XY values regularly spaced?) IDW may not interpolate across large gaps (depending on settings) whereas NatNeighbor will fill your tiles to the edges. How much time have you invested in your current files? If you've done a lot of editing and QC (I'm assuming these are bare earth ground points from LAS) and the file boundaries are very specific, you can proceed with this workflow, but I'm concerned about doing anything one tile at a time without considering neighbors - you may end up with slight artifacts at every edge that will give you an unpleasant result when all are combined. Is processing time a concern? The support doc you reference will take more processing time than the alternative I describe below, although realistically the learning curve and setup time on my recommended workflow will likely take you longer overall. Who will use the outputs, and in what software? (see end for explanation of this) The above should guide you to pick a good area to test - I'd suggest finding an area with some larger "NoData" gaps (if you have any) especially at tile boundaries, and process either 4 tiles in 2x2 arrangement or perhaps more, and look at a hillshade of the resulting outputs to see if there are edge effects. If any of your tiles have NoData at the edges (and you do fill the NoData voids), I'm sure you'll find discontinuities if you process these files separately to create DEMs. If you have not invested a lot of effort thus far in the files, and/or if a small test does not work out well, I'd encourage you to look at our recommended workflow for generating DEMs from Lidar in the Image Management Guidebook (look for the Aerial Lidar section here: Image Management ). This would presume you have good ground classification for your points in the LAS files, but I'm suggesting you may not want to use the XYZ point files and just use our workflow to go from LAS to tiled DEMs in Tiff format. This would process all of your data as one logical project (or several large projects, if it's really not contiguous data) to avoid edge artifacts, and the downloadable tool referenced in this workflow (LAS Dataset to Tiled Rasters) gives you a lot of flexibility for creating DEM tiles including file names, boundaries, and metadata to go with the tiles. re: my question #4 above, an option that some organizations use is NOT to fill the NoData voids (or "not if greater than XX pixels"), and then when the DEM tiles are used (presuming users have either ArcGIS Desktop/Pro or a web client built with our APIs), if you manage them with a Mosaic Dataset and add the "Elevation Void Fill" function, you can have a watertight DEM but allow the user to control the parameters of the void filling that best suit their application, and also explicitly see where the voids are so they know which values are being interpolated. I wouldn't suggest this if you have public users, but if you are serving technical staff in your organization, they may prefer to see the data voids before proceeding. I hope that is helpful. Cody B.
... View more
11-01-2016
11:52 AM
|
1
|
1
|
4571
|
|
POST
|
Jonathan It appears to me that your image was produced in NAD27 UTM 13, and the metadata was incorrectly written as NAD83. In this screenshot, I created the yellow polygon in NAD83, then I used DEFINE PROJECTION to rewrite the metadata as NAD27 and reloaded the new polygon (white). That shift appears to be pretty similar to what you're seeing in Y, although I'm not certain about X... Note I am only guessing at this point. You can use the DEFINE PROJECTION GP tool to change the projection for your imagery to NAD_1927_UTM_Zone_13N WKID: 26713 Authority: EPSG ...and then re-load it into your map and see if it lines up with the base map and feature data. But note if it is not pretty much perfect, then my guess is wrong and you should probably restore it to its original projection. In either case I'd suggest you contact MapMart (It appears that's where the data came from?) to see if they can confirm... Be sure to check the alignment at the extreme corners of your imagery - if I am correct it should be good everywhere. If not, then hopefully MapMart can track down the correct information. Finally note that ArcGIS does include Georeferencing tools that could be used to align this image, if you can't determine the correct projection, but using DEFINE PROJECTION would be preferable if you can be certain about what the correct projection should be. good luck Cody B
... View more
10-21-2016
01:48 PM
|
1
|
0
|
4772
|
|
POST
|
Jonathan ArcGIS will automatically reproject your imagery to match the current projection of your map; since your parcels line up correctly with the basemap, it appears your parcels are correct but I suspect that there is an error in the metadata that defines the projection of your imagery. You should not need to reproject your imagery, but (if my assumption is correct), edit the projection metadata using the Define Projection tool. Can you navigate to your imagery in ArcCatalog and right click to see Properties and let us know what it shows? If you purchased this imagery, I would contact the source and ask them to verify the projection - but if you can't confirm it is A) incorrect and B) what to change it to, let us know and we may be able to help figure it out. Presuming we get it right, your adjusted data should line up with the basemap as well as your vector dataset. If you edit the projection data, be sure to make complete notes about the original metadata before you change it - or better yet, save a *.PRJ file that shows the *current* projection before you change it. (If you don't know how, do this presuming you are using ArcMap: create a new map, load your raster dataset, then right click in the map. Select Data Frame Properties, Coordinate System tab, and you should see projection details in the lower window, and the projection name in the upper window. Select the projection name in the upper window, right click, and Save As to save a *.prj file. NOTE that this will save a file with the projection name, but if I am correct, this is the INCORRECT projection, so I would put it into a folder called something like "Original_projection_incorrect") Cody B.
... View more
10-20-2016
07:08 PM
|
0
|
2
|
4772
|
|
BLOG
|
Alin I was referring to activating DRA on a layer when displaying an image or Mosaic Dataset in the map. You can do this in ArcMap from Image Properties/Symbology/Stretch in the table of contents, or call up the Image Analysis Window, select the layer, and turn on the DRA checkbox. If using Pro, these appear in the Raster / Appearance tab. As described, this would apply only after loading an image into the map (or you can save an MXD (ArcMap) or APRX (Pro) project and these settings would be retained when you reload the project). But if you want a Mosaic Dataset (or image service based on the MD) to always display using DRA, yes, you can apply this as a Function. Use the Stretch function, and in the properties, select the DRA checkbox - but note you also have to set a stretch type other than "none". (It's a bit confusing because in the desktop map, if you click "DRA" it is applied immediately. In the function, if you click "DRA" but leave Type to None, then no stretch is applied, so you need both settings)
... View more
10-14-2016
12:39 PM
|
0
|
0
|
22850
|
|
BLOG
|
Alin I'm not aware of problems with calculating statistics - I just tried on a Mosaic Dataset with one Sentinel-2 scene, and skip factors of 3 x 3, and it took approximately 3 1/2 minutes, but the stats were successfully calculated & stored. Note that calculation of statistics is a longstanding issue because it can take so much time, and in some cases (e.g. elevation data), the results aren't terribly meaningful (such as "does anyone care what the mean elevation is for Spain?"). For viewing, I typically use dynamic range adjustment (DRA) stretch applied to only the area being displayed, and when I need statistics for large datasets to enable other functionality, I will often simply SET nominal statistics, knowing they are not precise, but that is often acceptable. You can set stats in just a few seconds using the set raster properties (data management) GP tool. Cody B
... View more
10-12-2016
03:56 PM
|
0
|
0
|
22850
|
|
BLOG
|
Alin I am not familiar with the new format, but I have verified that our Dev team is, and we're working to determine any changes that may be required. As for the 10m mosaic only showing Bands 2, 3 and 4, are you using ArcMap at 10.4? This is a limitation in the user interface for band selection after a Raster Function has been applied. Band 8 is there, but you can't access it by changing bands in the table of contents (TOC). Right click on the Image layer in the MD, select Properties then the Processing Templates tab, and choose Color Infrared or NONE. If you choose Color IR, you'll get bands 8 4 3. If you choose None, then all bands should appear in the TOC and you can select any of the 10m bands. If you want a Mosaic Dataset that references all 13 bands, run the "Multispectral" option in the tool I will try to clarify the documentation regarding how to access the different bands via the Table of Contents. Thanks Cody B.
... View more
10-11-2016
08:59 AM
|
1
|
0
|
22850
|
|
BLOG
|
Job You should use a Mosaic Dataset to access and process multiple images - see What is a mosaic dataset?—Help | ArcGIS for Desktop The Mosaic Dataset creates a VIRTUAL mosaic on-the-fly from many images, and allows you to do exactly what you're asking - apply band arithmetic to all images as if a mosaic, but the mosaic is dynamic (e.g. if you have an image w/ clouds in foreground, you can bring a background image to the foreground using the Mosaic Method). also note the Image Analysis Window allows you to run NDVI but specify any bands, so if you need that exact math, just use NDVI. You should not need to copy pixels and output new rasters, just do everything on-the-fly in the Mosaic Dataset, then if you really need an output image you can use Export to save to disk. Cody B.
... View more
10-11-2016
08:35 AM
|
0
|
0
|
22850
|
|
BLOG
|
Job My apologies if the user doc for that renaming script were not clear. Did you run it and not succeed? Wait, I see that the string you copied above ("Change parent_folder_path to the input folder to be renamed") comes directly from the script; did you see the user doc in the download? Text is copied below Cody B. If path renaming is required, users can run the script ‘RenameSentinel2Data.py’ (found in the Scripts folder) and pass in the name of the folder containing the GRANULE subfolder, e.g.: > python.exe RenameSentinel2Data.py d:\XXX_Long_Path_XXX\S2A_OPER_PRD_MSIL1C_PDMC_20150818T101216_R065_V20150806T102902_20150806T102902.SAFE If the user has multiple satellite scenes, the script ‘RenameSentinel2Data.py’ can take the root folder as input and will rename all subfolders named S2A*NAME.SAFE, e.g.: > python.exe RenameSentinel2Data.py d:\XXX_Long_Path_XXX
... View more
10-10-2016
01:06 PM
|
1
|
0
|
22850
|
| Title | Kudos | Posted |
|---|---|---|
| 2 | 3 weeks ago | |
| 1 | 02-07-2025 06:14 AM | |
| 2 | 05-16-2025 09:20 AM | |
| 1 | 05-16-2025 08:41 AM | |
| 7 | 02-26-2025 02:22 PM |
| Online Status |
Offline
|
| Date Last Visited |
a week ago
|