|
POST
|
Hi, We use the tool "Manage Tile Cache" on the local machine Desktop in ArcMap 10.5, for ArcGIS Server 10.3. Parameter "area_of_interest" is the feature class created by CacheWorx "Coverage To Feature" Level 19 The help says: "For the fastest tile creation, your CPU should be working near 100% during the tile creation" Having 16 cores CPU, and using ParallelProcessingFactor 100% or 16 the CPU usage is very low - between 3 to 8 percents In order to find a workaround I tried to use a script with multiprocessing. Unfortunately, it has an error at the run time. Please help to make it working. The script #run “Manage Tile Cache” tool in parallel processing import arcpy import multiprocessing import os import glob import sys import traceback from multiprocessing import Process, Queue, Pool, \ cpu_count, current_process, Manager arcpy.env.overwriteOutput = True arcpy.env.scratchWorkspace = "in_memory" AAA_Imagery = "D:/gisdata/imagery/public_AAA_Imagery/AAA_Imagery" Manage_Mode = "RECREATE_ALL_TILES" Scales__Pixel_Size___Estimated_Disk_Space_ = "564.248588" Best_WebM = "D:/gisdata/imagery/BestMosaic_2017test.gdb/Best_WebM" Level_20_coverage = "D:/gisdata/imagery/Levels_coverage.gdb/Level_20_coverage" def execute_task(bundleAOI): try: result = arcpy.ManageTileCache_management(AAA_Imagery, Manage_Mode, "", Best_WebM, "ARCGISONLINE_SCHEME", "", Scales__Pixel_Size___Estimated_Disk_Space_, bundleAOI, "", "591657527.591555", "282.124294") print(arcpy.GetMessages()) print "result: " + result except Exception, e: e.traceback = traceback.format_exc() raise if __name__ == '__main__': #get individual bundles, add it to a dictonary bundles = {} count = 1 for bundle in arcpy.da.SearchCursor(Level_20_coverage,["*"]): bundles[count] = bundle count += 1 # create a process pool and pass dictonary of extent to execute task pool = Pool(processes=cpu_count()) pool.map(execute_task, bundles.items()) pool.close() pool.join() The error (see the image)
... View more
06-25-2017
04:30 PM
|
0
|
0
|
1001
|
|
POST
|
In order to find a workaround I tried to use a script with multiprocessing. Unfortunately, it has an error at the run time. Please help to make it working. The script #run “Manage Tile Cache” tool in parallel processing import arcpy import multiprocessing import os import glob import sys import traceback from multiprocessing import Process, Queue, Pool, \ cpu_count, current_process, Manager arcpy.env.overwriteOutput = True arcpy.env.scratchWorkspace = "in_memory" AAA_Imagery = "D:/gisdata/imagery/public_AAA_Imagery/AAA_Imagery" Manage_Mode = "RECREATE_ALL_TILES" Scales__Pixel_Size___Estimated_Disk_Space_ = "564.248588" Best_WebM = "D:/gisdata/imagery/BestMosaic_2017test.gdb/Best_WebM" Level_20_coverage = "D:/gisdata/imagery/Levels_coverage.gdb/Level_20_coverage" def execute_task(bundleAOI): try: result = arcpy.ManageTileCache_management(AAA_Imagery, Manage_Mode, "", Best_WebM, "ARCGISONLINE_SCHEME", "", Scales__Pixel_Size___Estimated_Disk_Space_, bundleAOI, "", "591657527.591555", "282.124294") print(arcpy.GetMessages()) print "result: " + result except Exception, e: e.traceback = traceback.format_exc() raise if __name__ == '__main__': #get individual bundles, add it to a dictonary bundles = {} count = 1 for bundle in arcpy.da.SearchCursor(Level_20_coverage,["*"]): bundles[count] = bundle count += 1 # create a process pool and pass dictonary of extent to execute task pool = Pool(processes=cpu_count()) pool.map(execute_task, bundles.items()) pool.close() pool.join() The error (see the image)
... View more
06-22-2017
11:51 PM
|
0
|
0
|
1634
|
|
POST
|
We also uninstalled Desktop Background Geoprocessing.
... View more
06-22-2017
04:48 PM
|
0
|
0
|
1634
|
|
POST
|
We figured out the one reason: area of interest was the feature class with number of polygons more than 1. After we have dissolved the feature class it seems better: now, 20-30% of CPU usage (still not 90-100 ) Anthony, thank you for your response. We use 10.5, and 16 ArcSOCP processes for 16 core CPU are present. Another indication of the "proper" use of the tool is number of temporary *.lock" files in the cache folder.
... View more
06-21-2017
08:53 PM
|
0
|
0
|
1634
|
|
POST
|
Hi, We use the tool "Manage Tile Cache" in ArcMap 10.5, for ArcGIS Server 10.3. Parameter "area_of_interest" is the feature class created by CacheWorx "Coverage To Feature" Level 19 The help says: "For the fastest tile creation, your CPU should be working near 100% during the tile creation" Having 16 cores CPU, and using ParallelProcessingFactor 100% or 16 the CPU usage is very low - between 3 to 8 percents Any help will be greatly appreciated.
... View more
06-19-2017
11:10 PM
|
0
|
5
|
2513
|
|
POST
|
BUG-000101687: Using the Manage Map Server Cache Tiles tool with th..
ng the Manage Map Server Cache Tiles tool with the RECREATE_ALL_TILES option with the area of interest option with a feature class, the existing cached image service tiles are deleted and no new tiles are generated. http://support.esri.com/bugs/nimbus/QlVHLTAwMDEwMTY4Nw== ArcGIS 10.5.1 is scheduled to be released next month, which is where they have fixed the bug.
... View more
06-19-2017
10:52 PM
|
1
|
0
|
1388
|
|
POST
|
Hi, We need to update a tiles cache for existing map service with some new rasters. The workflow per one raster is: - Add a raster to a mosaic dataset - Run the "Manage Tile Cache" tool with "area_of_interest" of the footprint of new raster. - Robocopy bundles from the caclulating machine folder to the working cache folder. We noticed that using AOI polygon we do not have entire bundle recalculated, but only part. On the image attached - two bundles are not updated entirely, but only the tiles INSIDE of an AOI polygon (Cache Worx Tile Synopsis and CacheWorx Bundle Size) The question is how to recalculate an entire bundle (bundles) meaning a final bundle will contain tiles covering all area of the bundle? Please help.
... View more
05-31-2017
10:20 PM
|
0
|
1
|
1961
|
|
POST
|
I found it: In ArcMap, just right click on a mosaic data - will open a Prepare window (in case you have run the Analize.. before)
... View more
05-23-2017
10:57 PM
|
0
|
0
|
1514
|
|
POST
|
Thank you, Curtis, Please see here about a Prepare window. Tutorial: Publishing a map service—Documentation | ArcGIS Enterprise
... View more
05-23-2017
05:51 PM
|
0
|
0
|
1514
|
|
POST
|
Hi, I have a lengthy geoprocessing to analize the Mosaic dataset in ArcMap. At the end I have a Prepare window with Errors, Warnings, Messages Is there a functionality to save the content of a Prepare window with mxd? ArcGIS Desktop 10.3.1; 10.5 Any help please.
... View more
05-21-2017
06:53 PM
|
0
|
5
|
2378
|
|
POST
|
Hi, I run the tool in ArcCatalog 10.3.1, the geoprocessing Bundle Size No error message. No result. I suppose the message "returned non-zero exit status 3" should say something. With ArcCatalog I can see all paths used, no restricted permission. Log of the tool: Executing: Bundles \\somePath\arcgisserver\10.3\directories\arcgiscache\maps_Imagery2\Imagery2 D:\someOtherPath\ImageCacheTesting\BundleSize18 18 Start Time: Mon May 15 14:05:45 2017 Running script Bundles... Command '['D:\\Software\\python\\cache_worx', '-mode', 'coverage', '-level', '18', u'\\\\somePath\\arcgisserver\\10.3\\directories\\arcgiscache\\maps_Imagery2 \\Imagery2 ']' returned non-zero exit status 3 Completed script Bundles... Succeeded at Mon May 15 14:05:45 2017 (Elapsed Time: 0.07 seconds) Any help please.
... View more
05-14-2017
09:22 PM
|
0
|
0
|
1140
|
|
POST
|
Thank you Dan, I understand the meaning better now. From the testing I see that __the tool__ in 64BG runs slower with AOI specified. Uninstalled.
... View more
05-11-2017
06:03 PM
|
0
|
0
|
910
|
|
POST
|
Is the “Manage Tile Cache” geoprocessing tool designed for 64-bit multiproceesing? I have noticed that “This tool supports the Parallel Processing environment setting.” http://desktop.arcgis.com/en/arcmap/latest/tools/data-management-toolbox/manage-tile-cache.htm But it is not clear if it is relevant to 64-bit environment.
... View more
05-11-2017
04:14 PM
|
0
|
2
|
1371
|
|
POST
|
Thank you for your response Curtis, The task is Manage Tile Cache geoprocessing. I think it is memory consuming. As I see from the test of the tool (64-bit Background processing) - it DOES affect multiprocessing. And affect negatively. So, the only thing is uninstall?
... View more
05-10-2017
07:47 PM
|
0
|
2
|
2372
|
| Title | Kudos | Posted |
|---|---|---|
| 1 | 09-14-2017 10:40 PM | |
| 1 | 02-13-2019 05:03 PM | |
| 1 | 04-12-2017 09:41 PM | |
| 1 | 11-14-2017 06:00 PM | |
| 1 | 06-19-2017 10:52 PM |
| Online Status |
Offline
|
| Date Last Visited |
09-13-2021
09:41 PM
|