topic Re: Estimating Map downloadable size while Caching the map in ArcGIS Runtime SDK for iOS Questions

Estimating Map downloadable size while Caching the map

AjiteshUpadhyaya — Wed, 10 Apr 2024 12:35:00 GMT

Hello Experts,

We would need to show the Estimated time to complete the caching of map. This can be done if we have some reference on how much is already downloaded to the device and the total size of the map.

For the same, i have written code something like below, but not getting how can i calculate/get how much has been downloaded.

-(void) cacheBasemapParameters:(AGSExportTileCacheParameters *)params withSteps:(int) steps { [self deleteExistingTPKFile]; // Use a weak variable for self within the blocks __weak EsriMapViewController *weakSelf = self; // temp file NSURL *tempFileDirectoryUrl = [[NSFileManager.defaultManager temporaryDirectory] URLByAppendingPathComponent:NSProcessInfo.processInfo.globallyUniqueString]; NSURL* docDirectoryURL = [[[NSFileManager defaultManager] URLsForDirectory:NSDocumentDirectory inDomains:NSUserDomainMask] lastObject]; [NSFileManager.defaultManager createDirectoryAtURL:tempFileDirectoryUrl withIntermediateDirectories:YES attributes:nil error:nil]; NSString *extension = @".tpk"; if (self.tileCacheTask.mapServiceInfo.exportTileCacheCompactV2Allowed) { extension = @".tpkx"; } NSURL *tempFileUrl = [docDirectoryURL URLByAppendingPathComponent:[@"myTileCache" stringByAppendingString:extension]]; // Kick-off operation AGSExportTileCacheJob *job = [self.tileCacheTask exportTileCacheJobWithParameters:params downloadFileURL:tempFileUrl]; self.cacheJob = job; [self.cacheJob startWithStatusHandler:^(AGSJobStatus status) { //Print the job status DLog(@"%d", status); //NSArray *allMessages = [userInfo objectForKey:@"messages"]; //Display download progress if we are fetching result /*if (status == 3) { NSNumber* totalBytesDownloaded = userInfo[@"AGSDownloadProgressTotalBytesDownloaded"]; NSNumber* totalBytesExpected = userInfo[@"AGSDownloadProgressTotalBytesExpected"]; if(totalBytesDownloaded!=nil && totalBytesExpected!=nil){ double dPercentage = (double)([totalBytesDownloaded doubleValue]/[totalBytesExpected doubleValue]) * 100; [weakSelf showProgressWithMessage:[NSString stringWithFormat:@"%@\n%.2f%% %@", statusMessageTitle, dPercentage, [weakSelf.dataSource textValueForKey:@"DownloadStatus"]]]; } }else if ( allMessages.count) { [weakSelf showProgressWithMessage:[self extractMostRecentMessage:allMessages]]; } */ } completion:^(AGSTileCache * _Nullable result, NSError * _Nullable error) { if (error){ [weakSelf hideProgress]; //alert the user [ViewUtils showSimpleAlertWithTitle:[self.dataSource textValueForKey:@"Error"] message:[self.dataSource textValueForKey:@"BasemapDownloadError"] cancelButtonTitle:[self.dataSource textValueForKey:@"Ok"]]; // no need to proceed further if basemaps cannot be downloaded. } else{ DLog(@"Successfully downloaded basemap"); // start downloading feature layers if(weakSelf.featureLayersToCache.count > 0){ // delete all cached feature layers [self deleteCachedGeodatabases]; [self.gdbFeatureLayerMap removeAllObjects]; } [weakSelf cacheNextFeatureLayer]; } }]; }

Any idea on how to get it done?

Thanks,

Ajitesh

Re: Estimating Map downloadable size while Caching the map

Ting — Wed, 10 Apr 2024 22:41:28 GMT

Feel free to poke around the AGSEstimateTileCacheSizeResult API.

Unfortunately I don't have an example code snippet handy, so you can give it a try and let me know if you have any trouble. 😬

Please note, this API only works with image tiles, not vector tiles. We currently don't have a way to estimate the vector tile cache export size yet.

Re: Estimating Map downloadable size while Caching the map

AjiteshUpadhyaya — Thu, 11 Apr 2024 11:14:21 GMT

Thank you Ting for your quick response.

With AGSEstimateTileCacheSizeResult , if i read it correctly, it doesnt have any option to save the cache file locally for future uses(My application has offline capabilities).

Still, i tried writing the code as below it doesnt do anything.. also, i believe it returns the file size only when it goes to 'Completion' method.

any help on this is really helpful.

[self.tileCacheTask exportTileCacheParametersWithAreaOfInterest:extent minScale:minScale maxScale:maxScale completion:^(AGSExportTileCacheParameters * _Nullable exportTileCacheParameters, NSError * _Nullable error) { if (error) { //TODO: display error } else { AGSEstimateTileCacheSizeJob *job = [self.tileCacheTask estimateTileCacheSizeJobWithParameters:exportTileCacheParameters]; [job startWithStatusHandler:^(AGSJobStatus status) { DLog(@"estimation status: %ld", (long)status); NSString * statusMessageTitle = [NSString stringWithFormat:@"%@ %@",[self.dataSource textValueForKey:@"DownloadPrepare"], basemap]; [self showProgressWithMessage:statusMessageTitle]; } completion:^( AGSEstimateTileCacheSizeResult * _Nullable result, NSError * _Nullable error) { DLog(@"estimated file size: %llu", result.fileSize); NSString * statusMessageTitle = [NSString stringWithFormat:@"%@ %@",[self.dataSource textValueForKey:@"DownloadPrepare"], basemap]; [self showProgressWithMessage:statusMessageTitle]; //[self cacheBasemapParameters:exportTileCacheParameters withSteps:steps]; }];

Re: Estimating Map downloadable size while Caching the map

Ting — Thu, 11 Apr 2024 23:52:47 GMT

With AGSEstimateTileCacheSizeResult , if i read it correctly, it doesnt have any option to save the cache file locally for future uses(My application has offline capabilities).

That is correct. This API is only for estimating the file size and tile count. You'll still need to create a AGSExportTileCacheJob to download the tile cache.

Still, i tried writing the code as below it doesn't do anything..

This is a typically problem for async AGSJobs. Because the jobs runs asynchronously, once the job variable is assigned, it needs to have a lifespan longer than its asynchronous completion block, in order to get the results.

The common pattern is to hold the job as an instance property, such as (self.estimateJob = …)

exportTask.exportTileCacheParameters( withAreaOfInterest: areaOfInterest, minScale: minScale, maxScale: maxScale ) { [weak self, unowned exportTask] (params: AGSExportTileCacheParameters?, error: Error?) in guard let self else { return } if let params = params { let job = exportTask.estimateTileCacheSizeJob(with: params) self.estimateJob = job job.start(statusHandler: nil) { result, error in if let result { print("Tile count", result.tileCount) let formatter = ByteCountFormatter() formatter.allowedUnits = .useAll formatter.countStyle = .file formatter.includesUnit = true formatter.isAdaptive = true print("File size", formatter.string(fromByteCount: Int64(result.fileSize))) } else if let error { print(error.localizedDescription) } } // Below export tiles logics… } else if let error = error { print(error.localizedDescription) } }

I don't have much template code for ObjC, so bear with my Swift answer. 😉

also, i believe it returns the file size only when it goes to 'Completion' method.

This is correct. Because the estimation happens on the server side, this method is asynchronous. The code is messy with ObjC and completion block, but is much nicer with Swift Concurrency async/await. Hope you can start using it soon!

Please see this article for the completion handler async programming pattern.

Re: Estimating Map downloadable size while Caching the map

AjiteshUpadhyaya — Fri, 12 Apr 2024 13:00:42 GMT

Thank you so much Ting for the help.

It's working now. but its not getting changed frequently as it should(please see attached screenshot). Any idea how can i get hold off the status for longer time?

Re: Estimating Map downloadable size while Caching the map

Ting — Sat, 13 Apr 2024 00:45:11 GMT

Can you elaborate on what you means? Did you intend to upload a GIF?

Do you mean you want more frequent progress value updates, or want to show the status/progress spinner for a longer period of time?

Re: Estimating Map downloadable size while Caching the map

AjiteshUpadhyaya — Sat, 13 Apr 2024 05:00:11 GMT

I mean, to show the more frequent progress value updates.

On the progress bar, i'm showing 61KB/36.6 MB downloaded(as per above screenshot). When it downloads more data to the device the value of 61KB should get changed and should show the updated values..

Any idea how to achieve this? Is it possible?

Re: Estimating Map downloadable size while Caching the map

Ting — Mon, 15 Apr 2024 17:46:17 GMT

Thanks for the details. Upon my tests, the progress does jump from 11% to 89% without any fraction values in between. We'll see if it is a known issue or not.

Re: Estimating Map downloadable size while Caching the map

AjiteshUpadhyaya — Wed, 17 Apr 2024 06:20:21 GMT

This is interesting..In my case, when it started it was on 291 bytes and it stays as it is till the download gets completed. Please see attached video.

(view in My Videos)

Re: Estimating Map downloadable size while Caching the map

Ting — Thu, 18 Apr 2024 23:23:52 GMT

Can you share the code snippet you use to retrieve the file size downloaded?

Instead of monitoring the file size, I suggest observing the exportTileCacheJob.progress instead. Sth like below

jobProgressObservation = exportTileCacheJob.progress.observe(\.fractionCompleted, options: .new) { [weak self] (progress, _) in print(progress.fractionCompleted) }

While it doesn't tell how much file size has been downloaded, it gives you a series of percentage of the job's current progress.

For example, below is the extent I tried to export.

Tile count: 321, File size: 7.1 MB
progress.fractionCompleted output: 0.01, 0.02, 0.03, 0.04, 0.06, 0.07, 0.09, 0.11, 0.12, 0.17, 0.27, 0.39, 0.6, 0.8, 1.0

Re: Estimating Map downloadable size while Caching the map

AjiteshUpadhyaya — Fri, 19 Apr 2024 06:27:34 GMT

Thanks Ting, for looking into it. Please find below my code snippet for the complete method for caching.

[self initCacheTaskForUrl:abo.basemapURL]; double minScale = self.mapView.mapScale; //double maxScale = self.tileCacheTask.mapServiceInfo.maxScale; double maxScale = self.mapView.map.basemap.baseLayers.firstObject.maxScale; if (minScale < maxScale) { minScale = maxScale; } if (isnan(maxScale)) { maxScale = minScale; } AGSEnvelope *extent = [self.mapView visibleArea].extent; [self.tileCacheTask exportTileCacheParametersWithAreaOfInterest:extent minScale:minScale maxScale:maxScale completion:^(AGSExportTileCacheParameters * _Nullable exportTileCacheParameters, NSError * _Nullable error) { if (error) { //TODO: display error } else { // AGSEstimateTileCacheSizeJob *job = [self.tileCacheTask estimateTileCacheSizeJobWithParameters:exportTileCacheParameters]; // [job startWithStatusHandler:^(AGSJobStatus status) { // DLog(@"estimation status: %ld", (long)status); // } completion:^( AGSEstimateTileCacheSizeResult * _Nullable result, NSError * _Nullable error) { // DLog(@"estimated file size: %llu", result.fileSize); // [self cacheBasemapParameters:exportTileCacheParameters withSteps:steps]; // }]; //EWU2-9, EWU2-12 Cache Progress indicator does not exist NSString * statusMessageTitle = [NSString stringWithFormat:@"%@ %@",[self.dataSource textValueForKey:@"DownloadPrepare"], basemap]; _currentActivity = GISActivityCachingMaps; [self showProgressWithMessage:statusMessageTitle]; [self deleteExistingTPKFile]; // Use a weak variable for self within the blocks __weak EsriMapViewController *weakSelf = self; // temp file NSURL *tempFileDirectoryUrl = [[NSFileManager.defaultManager temporaryDirectory] URLByAppendingPathComponent:NSProcessInfo.processInfo.globallyUniqueString]; NSURL* docDirectoryURL = [[[NSFileManager defaultManager] URLsForDirectory:NSDocumentDirectory inDomains:NSUserDomainMask] lastObject]; [NSFileManager.defaultManager createDirectoryAtURL:tempFileDirectoryUrl withIntermediateDirectories:YES attributes:nil error:nil]; NSString *extension = @".tpk"; if (self.tileCacheTask.mapServiceInfo.exportTileCacheCompactV2Allowed) { extension = @".tpkx"; } NSURL *tempFileUrl = [docDirectoryURL URLByAppendingPathComponent:[@"myTileCache" stringByAppendingString:extension]]; //DLog(@"%d", status); AGSEstimateTileCacheSizeJob *jobCacheSize = [self.tileCacheTask estimateTileCacheSizeJobWithParameters:exportTileCacheParameters]; self.estimateJob = jobCacheSize; [jobCacheSize startWithStatusHandler:nil completion:^(AGSEstimateTileCacheSizeResult *result, NSError *error) { if (result) { DLog(@"Tile count: %lld", result.tileCount); NSByteCountFormatter *formatter = [[NSByteCountFormatter alloc] init]; formatter.allowedUnits = NSByteCountFormatterUseAll; formatter.countStyle = NSByteCountFormatterCountStyleFile; formatter.includesUnit = YES; formatter.adaptive = YES; DLog(@"Tile count: %lld", [formatter stringFromByteCount:result.tileCount]); DLog(@"File size: %@", [formatter stringFromByteCount:result.fileSize]); NSNumber* totalBytesDownloaded = [formatter stringFromByteCount:result.tileCount]; NSNumber* totalBytesExpected = [formatter stringFromByteCount:result.fileSize]; // Convert NSNumber objects to strings NSString* downloadedString = [totalBytesDownloaded stringValue]; NSString* expectedString = [totalBytesExpected stringValue]; // Create the desired format: 'totalBytesDownloaded/totalBytesExpected' NSString* ratioString = [NSString stringWithFormat:@"%@/%@", downloadedString, expectedString]; //double dPercentage = (double)([totalBytesDownloaded doubleValue]/[totalBytesExpected doubleValue]) * 100; [weakSelf showProgressWithMessage:[NSString stringWithFormat:@"%@\n %@ %@", statusMessageTitle, ratioString, [weakSelf.dataSource textValueForKey:@"DownloadStatus"]]]; //[self cacheBasemapParameters:exportTileCacheParameters withSteps:steps]; } else if (error) { DLog(@"%@", error.localizedDescription); } }]; // Kick-off operation AGSExportTileCacheJob *job = [self.tileCacheTask exportTileCacheJobWithParameters:exportTileCacheParameters downloadFileURL:tempFileUrl]; self.cacheJob = job; [self.cacheJob startWithStatusHandler:^(AGSJobStatus status) { } completion:^(AGSTileCache * _Nullable result, NSError * _Nullable error) { if (error){ [weakSelf hideProgress]; //alert the user [ViewUtils showSimpleAlertWithTitle:[self.dataSource textValueForKey:@"Error"] message:[self.dataSource textValueForKey:@"BasemapDownloadError"] cancelButtonTitle:[self.dataSource textValueForKey:@"Ok"]]; // no need to proceed further if basemaps cannot be downloaded. } else{ DLog(@"Successfully downloaded basemap"); // start downloading feature layers if(weakSelf.featureLayersToCache.count > 0){ // delete all cached feature layers [self deleteCachedGeodatabases]; [self.gdbFeatureLayerMap removeAllObjects]; } [weakSelf cacheNextFeatureLayer]; } }];

Re: Estimating Map downloadable size while Caching the map

Ting — Fri, 19 Apr 2024 16:57:53 GMT

                    NSNumber* totalBytesDownloaded = [formatter stringFromByteCount:result.tileCount];
                    NSNumber* totalBytesExpected = [formatter stringFromByteCount:result.fileSize];

This is not correct. The estimate job only gives you the estimation of total amount of tiles to be downloaded, and the estimated file size from the server. It doesn't provide real time update for the progress.

What you have here is showing the static tileCount/fileSize, which doesn't have a real meaning.

For fraction completed of the AGSExportTileCacheJob, see my previous comment.

Re: Estimating Map downloadable size while Caching the map

AjiteshUpadhyaya — Tue, 23 Apr 2024 07:01:32 GMT

This worked, Thanks a lot Ting for the help.