topic Re: Tracks not showing after update in ArcGIS Field Maps Questions

Tracks not showing after update

kmsmikrud — Fri, 16 Apr 2021 01:05:28 GMT

Hi,

Today a coworker that has been using tracker within Field Maps for the last 2 months was not able to collect any tracks despite having tracks enabled. I think this could in part be due to the update and they have not installed the latest release. However even if they don't have the latest functionality it seems not right to lose the ability altogether? Another coworker who is planning to survey tomorrow updated their Field Maps app, said that when connected to their external GPS device they kept getting a message that the GPS was not providing accuracy information, so it was using an estimate instead. They said in their testing of the app before today they never received this message and the tracks just showed up on the map.

If folks haven't updated their Field Maps app because they are offline, will they now not be able to use the tracks? I do not have a tracker extension but set up projects for others that do and it seems that at least two people today that have tried to use tracks are having difficulty where it just easily worked before within Field Maps.

Also with the new line feature, if I currently have created track views with the 'Tracks' point layer and 'Last Known Locations' point layer, how do I get the new line layer? Do I have to delete those views and create new ones to get the line? Is there a way to just update the view to include the line? I a good number of views set up in projects.

I appreciate any insight on the changes and the message about GPS not providing accuracy information above so I can better help our staff.

Thanks,

Kathy

Re: Tracks not showing after update

Anonymous User — Fri, 16 Apr 2021 14:56:44 GMT

Hi @kmsmikrud can you clarify a few things:

1. Are these issues occurring on Android or iOS?

2. Are the tracks not collected locally? Or are they not being uploaded to the server?

I would not expect any issues with collecting tracks after updating the app. It's possible there's a bug. Any additional information would be helpful.

Regarding the lines layer. Unfortunately at that last minute we had to postpone updating the location tracking service backend to sort through some performance issues. This under active development and we aim to push out an update as soon as possible but estimated date is unknown at this time. So the track lines functionality is currently not available.

When it is available, any existing views will automatically be updated to have the new layer and will have lines generated for previous tracks. Additionally, any new views that are created will have the new layer.

I am assuming you are seeing the GPS message on Android devices. This was an intentional change. On many Android devices the integrated receiver supports NMEA strings and the if the string does not contain a GST sentence then you will see the messaging saying that accuracy is estimated and a true accuracy is not available.

Re: Tracks not showing after update

kmsmikrud — Fri, 16 Apr 2021 15:01:04 GMT

Hi @Anonymous User ,

1. These issues are all on iOS (iPad Pro)

2. Yesterday when the one surveyor synced no tracks uploaded to AGOL. They haven't had an issue prior to yesterday. They hadn't updated their app, but had tracks enabled outside and inside the map.

3. The GPS message was also on iOS and seen on both the integrated GPS and when connected to bluetooth GPS.

I will see if I can find out more information today from the users. Thanks for the response!

Re: Tracks not showing after update

Anonymous User — Fri, 16 Apr 2021 15:10:27 GMT

Thanks, for the tracking issue, if the surveyor could open the "Troubleshooting" menu in Field Maps (on the profile page) there likely are logs related to track uploads failing. If you could provide those it'd be really helpful.

Can you share which GPS receiver is being used when the estimated accuracy message is presented?

Re: Tracks not showing after update

kmsmikrud — Mon, 19 Apr 2021 16:56:03 GMT

Hi @Anonymous User ,

Currently there have been 3 users that are having tracking issues all using iPad Pros. I've included the log from one of the users. This person has been using the same device for the past few months and for the last weeks using tracks daily. They haven't changed any of the accuracy settings within Field Maps. However it wasn't until last week that the surveyor was unable to get the tracks to work. What's really strange is the tracks worked on a morning survey, but then the surveyor could not get the tracks to work for the afternoon survey. The troubleshooting log is included and at the very end/earliest time you can find info on the tracks. They were just trying to use the integrated iPad Pro GPS but had been also using Garmin Glo.

I will be sending info from another surveyor that has been getting those accuracy messages consistently since the update. They also have an iPad Pro and Garmin Glo 2 I believe, but will confirm. In their testing prior using both the integrated GPS and external they did not receive those errors. They officially started surveying late last week/weekend just in time for the tracks to be very inconsistent which is unfortunate on the timing. More info from those logs soon.

Thanks in advance for your help in solving this,

Kathy

Re: Tracks not showing after update

kmsmikrud — Sat, 24 Apr 2021 17:25:14 GMT

Hello @Anonymous User ,

I'm sending troubleshooting logs from Field Maps from one of the users that continues to have issues with the tracks. They are using an iPad Pro and Garmin Glo 2. They have had the tracks work but inconsistent and yesterday they didn't work at all.

Could you also explain how ArcGIS Tracker and my tracks within Field Maps coordinate? Would it be more reliable for a user to enable/disable tracks using ArcGIS Tracker than just within Field Maps? The reason I ask is another user also using iPad Pro and external GPS had turned their tracks off within Field Maps, but then forgot they had initially enabled the tracks in the ArcGIS Tracker app. That particularly user has had great success lately with consistent tracks. However this has not been the case for a couple other users who are having difficulties.

Hopefully the troubleshooting logs help identify the issue.

Looking forward to your response,
Kathy

Re: Tracks not showing after update

Anonymous User — Sun, 25 Apr 2021 23:47:00 GMT

Hi @kmsmikrud I looked at the three logs.

For 0423 log.txt file it seems like the user if offline for most the day. In the logs it looks like sometime around 4pm the tracks all get uplooaded in several batches of 500 points each.

There is an entry here:

4/20/21, 6:03 PM Failed to upload tracks: Upload tracks error: The operation couldn’t be completed. (Tracks.TrackingManager.TrackingManagerUploadTracksError error 1.) 4/20/21, 6:03 PM Failed to upload tracks 4/20/21, 6:03 PM ↓ additional info: apply edits to tracks table failed: The request timed out.

Which seems to imply the device became disconnected from ArcGIS Online and the tracks stopped uploading. There were still 15860 tracks to upload that were collected on 4/20.
Then on 4/21 a similar thing happens where the app is not able to upload all of the tracks are there still 35181 tracks that are un-uploaded. It seems like the device went offline or the app was closed at 4:49pm.

4/22/21, 10:42 AM Found an Exploded Map Package at: file:///private/var/mobile/Containers/Data/Application/71389428-CF02-4303-82C8-249FB2D8D467/Documents/christopher.shepherd_adfg@VdkVOAHovLuozJG4/mapareas/1e61298bd3e1489fa2d1f9f5ea520b08/d792345124ca4786ba26cd98e4b368f0/ 4/21/21, 4:49 PM Pending features: 35181 4/21/21, 4:49 PM Uploaded 500 features (6 sec)

Then the same thing happens again on 4/22 where the app simply isn't connected to AGOL long enough to upload all the tracks.

In summary it seems like the app is collecting more tracks per day than can be uploaed over the period of time the app is connected to AGOL. The app uploads tracks in batches of 500 at a time when connected and for some days all of the days tracks are not uploaded. This continues on day after day and the problem gets worse and worse.

For the PWSHerring_0005_logs.txt. For couple days it was working but then the same issue happens here as in the previous log file:

4/20/21, 10:33 AM Found an Exploded Map Package at: file:///private/var/mobile/Containers/Data/Application/71389428-CF02-4303-82C8-249FB2D8D467/Documents/christopher.shepherd_adfg@VdkVOAHovLuozJG4/mapareas/1e61298bd3e1489fa2d1f9f5ea520b08/d792345124ca4786ba26cd98e4b368f0/ 4/19/21, 4:08 PM Failed to upload tracks: Upload tracks error: The operation couldn’t be completed. (Tracks.TrackingManager.TrackingManagerUploadTracksError error 1.) 4/19/21, 4:08 PM ↓ additional info: host unreachable 4/19/21, 4:08 PM Failed to upload tracks 4/19/21, 4:04 PM Uploading 500 features 4/19/21, 4:04 PM Pending features: 16879

So all of those 16879 tracks were not uploaded.

For the PWSHerring_0006_logs I don't really see any issues. It seems like tracking is started and stopped a lot though and not many tracks are collected.

We do have an issue in our backlog to added a status indicating when there are tracks that are pending upload. I think this might help at least inform your workers that all the tracks are not uploaded.

Could you explain what the operating procedure is at the end of day? Are the devices turned off? Is the app closed? Are the devices plugged in to charge?

The same logic and even most of the code is the same between Tracker and Field Maps so the recommendation is to use Field Maps for location tracking. We are putting all of our current and future tracking enhancements into Field Maps. On iOS when an external receiver is paired, all locations flow through CoreLocation so Tracker and Field Maps will get the same information if both were running.

Re: Tracks not showing after update

Shane_Shepherd — Mon, 26 Apr 2021 18:09:57 GMT

Hi Aaron,

I'm the user who created the 0423, 0005 and 0006 logs.

To answer your question:

When I come in from a survey, I manually tell my offline map in Field Maps to sync once I am back in WiFi range and keep the device active until the sync progress wheel completes. Then the device is left powered on and plugged in to charge, and the Field Maps app is typically left open, however the screen usually locks fairly quickly after I finish syncing.

I have a few questions - how long should it take to upload the remaining tracks?

How will I know there is still an upload in progress, or how much remains?

Is there something I should be doing differently to ensure the tracks upload?

Will having tracks to be uploaded in the queue prevent tracks from appearing on the offline map during the survey? That is the issue I am commonly having.

Thank you for your assistance!

- Shane

Re: Tracks not showing after update

Anonymous User — Mon, 26 Apr 2021 20:26:41 GMT

Hi Shane,

Thanks for those details. We looked into this a bit more and think you have run into a scenario that the app doesn't handle well.

From your logs it looks like you stopped tracking, then got to the office, when you entered the office it connected to the WiFi and tracks automatically started uploading. Tracks are uploaded in batches of 500 features at a time. They are not sync'd like other map data. Anyway, so one of those batches failed to upload for some network or server related issue. This caused any remained uploads to stop (which is the bug).

After this failure the app should have re-tried to upload tracks after 1 minute but it didn't. I'm going to log a bug for us to look into it more and hopefully address this issue.

We do have a design proposed that would show if there are tracks that are pending upload. I imagine this will be implemented some time later this year. I think it would have helped in this case.

The uploading of tracks is completely independent from the tracks appearing in the map. In Field Maps or Tracker try turning off the "smart rendering" option. In Field Maps, you can do this on by tapping the options button on the My Tracks layer. If you are getting locations on the iPad that are not from the external receiver they may not meet the criteria to be displayed. We have seen that in the past with iPads that do not have an integrated GPS.

Re: Tracks not showing after update

Shane_Shepherd — Mon, 26 Apr 2021 23:39:53 GMT

Hi Aaron,

I've tried turning off the "smart rendering" option, and the tracks do not appear. Disabling smart rendering did cause some tracks to display during some tests when I was using the internal GPS while indoors, so I tried that while using the Garmin GLO 2 during my surveys to see if that was the issue and it was not. Since the latest patch of Tracker, Field Maps has been displaying a message that my Garmin GLO 2 was not providing accuracy information, and that accuracy would be estimated, which typically shows up at 3.6m or so and is within the threshold I set in my profile. Could this be related?

Re: Tracks not showing after update

kmsmikrud — Wed, 05 May 2021 17:48:58 GMT

Hi @Anonymous User ,

Thanks for the information regarding the tracks and how they upload. We actually had another user yesterday that said during their offline use/aerial survey the tracks showed up great, but I did not see any of their tracks uploaded to AGOL. Can you recommend what the user should do to now get those tracks uploaded to AGOL since their other survey data all synced? I have uploaded the log that shows the pending tracks and failed to upload. How do we get the tracks????? These tracks are from aerial surveys and colllected offline after hours of flying and right now daily flights. Is this the same bug and will it become a cumulative issue for today's flight and not being able to access the tracks? We really need the tracks to extract the altitude values to be used in survey estimate.

Also regarding tracks not showing up at all as @Shane_Shepherd mentions below. This was also the case for another user in which I included the troubleshooting log from 041921. While the tracks can work great at times we have had a number of issues where tracks cut in and out or the user can't get them to work at all such as what Shane describes below. It would be great to have more information to troubleshoot and get the tracks to work in these cases. Having the tracks display within the app is a great addition to data collection, but at the moment the tracks seem less than reliable in some cases.

I appreciate the information for the enhancement for showing pending tracks, I think this will be a good addition.

Thanks,

Kathy

Re: Tracks not showing after update

Anonymous User — Wed, 05 May 2021 23:45:23 GMT

Hi @kmsmikrud I've logged some issues internally to address the root cause of tracks not fully uploading. We are planning to address these for our June update. In the meantime, if you toggle tracking on/off it should trigger an upload of any pending tracks. If you look at the troubleshooting logs you will be able to see each batch of features upload. That's the best work-around for now.

The attached log has the same issue as the previous logs where some batches upload and then a batch fails due to what appears to be a network issue. Then the remaining tracks are not uploaded. So if in the morning before going offline tracking was toggled on/off it should trigger another upload attempt.

I'm not sure about why tracks wouldn't be captured. Can you describe how the devices are mounted/used? I haven't heard of a use-case like this before but it makes a lot of sense. I know when I've flown on commercial flights my tracks were not always recorded as expected -t he phone couldn't get location at times.

Re: Tracks not showing after update

kmsmikrud — Thu, 06 May 2021 02:00:40 GMT

Hi @Anonymous User ,

Thanks again for the information and review of the log file. It looks like after today's survey both tracks from yesterday and today uploaded so that is good news. I also appreciate the work-around for trying to trigger the tracks to upload.

We've had two of the surveyors not be able to get the tracks to be captured and one of them had successfully been collecting them for months until that last update. When I say aerial surveys these are in Alaska on Cessna and Super Cubs, so much smaller than the larger commercial aircraft.

The department has been using ArcPad for years in some areas for fisheries management, but in the last year have been migrating from ArcPad or from paper. Here is a web app showing one area survey's.

Southeast AK Herring Surveys 2021 (arcgis.com)

The biologists have the external GPS up on the dash of the aircraft that are blue-toothed to the iPad Pros. The tablets are just in their hands as they look out the window.

Hope this information is helpful because I feel like wildlife/fisheries surveys are a pretty common use case.

Thanks,

Kathy

Re: Tracks not showing after update

kmsmikrud — Fri, 07 May 2021 14:51:13 GMT

Hi @Anonymous User ,

One of the groups was out surveying yesterday and the one surveyors had a frustrating time with the tracks not working for a great distance and then repeatedly cutting in and out. The entire time the surveyor is seated in the plane. I've attached the troubleshooting log from yesterday and below is just one section where you can see the tracks are having an issue. The surveyor is using an iPad Pro with Garmin Glo external GPS.

5/6/21, 10:31 AM Tracking started 5/6/21, 10:31 AM Tracking stopped 5/6/21, 10:31 AM Deactivating snapping 5/6/21, 10:31 AM Activating snapping 5/6/21, 10:30 AM Failed to update last known location 5/6/21, 10:30 AM stationary updating LKL service with last location 5/6/21, 10:29 AM Failed to update last known location 5/6/21, 10:29 AM stationary updating LKL service with last location 5/6/21, 10:29 AM Regenerating lines 5/6/21, 10:29 AM Regenerating lines 5/6/21, 10:29 AM Regenerating lines 5/6/21, 10:29 AM Regenerating lines 5/6/21, 10:28 AM Failed to update last known location 5/6/21, 10:28 AM stationary updating LKL service with last location 5/6/21, 10:28 AM Regenerating lines 5/6/21, 10:27 AM Location Manager failed: The operation couldn’t be completed. (kCLErrorDomain error 0.) 5/6/21, 10:27 AM Current activity: Automotive Confidence: Low 5/6/21, 10:27 AM Location Manager failed: The operation couldn’t be completed. (kCLErrorDomain error 0.) 5/6/21, 10:27 AM Current activity: Automotive Confidence: Low 5/6/21, 10:27 AM Tracking started 5/6/21, 10:27 AM Tracking stopped 5/6/21, 10:26 AM Regenerating lines 5/6/21, 10:26 AM Current activity: Unknown Confidence: Low 5/6/21, 10:26 AM Location Manager failed: The operation couldn’t be completed. (kCLErrorDomain error 0.) 5/6/21, 10:26 AM Tracking started 5/6/21, 10:26 AM Tracking stopped 5/6/21, 10:26 AM Failed to update last known location 5/6/21, 10:26 AM stationary updating LKL service with last location 5/6/21, 10:25 AM Failed to update last known location 5/6/21, 10:25 AM stationary updating LKL service with last location 5/6/21, 10:25 AM tracks fail-safe timer triggered 5/6/21, 10:24 AM Failed to update last known location 5/6/21, 10:24 AM stationary updating LKL service with last location 5/6/21, 10:23 AM Failed to update last known location 5/6/21, 10:23 AM stationary updating LKL service with last location 5/6/21, 10:22 AM Failed to update last known location 5/6/21, 10:22 AM stationary updating LKL service with last location 5/6/21, 10:21 AM Failed to update last known location 5/6/21, 10:21 AM stationary updating LKL service with last location 5/6/21, 10:20 AM Failed to update last known location 5/6/21, 10:20 AM stationary updating LKL service with last location 5/6/21, 10:19 AM Failed to update last known location 5/6/21, 10:19 AM stationary updating LKL service with last location 5/6/21, 10:18 AM Failed to update last known location 5/6/21, 10:18 AM stationary updating LKL service with last location 5/6/21, 10:17 AM Failed to update last known location 5/6/21, 10:17 AM stationary updating LKL service with last location 5/6/21, 10:16 AM Failed to update last known location 5/6/21, 10:16 AM stationary updating LKL service with last location 5/6/21, 10:15 AM Current activity: Automotive Confidence: High 5/6/21, 10:15 AM Location Manager failed: The operation couldn’t be completed. (kCLErrorDomain error 0.) 5/6/21, 10:14 AM Failed to update last known location 5/6/21, 10:14 AM stationary updating LKL service with last location

Currently there are 2 surveyors in the plane using Field Maps with the tracker extension, between the two of them I don't think in the last 4 surveys they have had a day where both surveyors were able to easily collect tracks the entire survey, one or both of them would have tracks stop/start throughout the survey.

Thanks for your insight as to what might be happening. I believe this is similar to Shane Shepherd's experience as well.

Thanks,

Kathy

Re: Tracks not showing after update

Anonymous User — Fri, 07 May 2021 16:26:45 GMT

Are there gaps in tracks only when you see lines like this in the logs?

Location Manager failed: The operation couldn't be completed. (kCLErrorDomain error 0.)

Could you compare the track point location_timestamp values to the times in the logs and see there's any pattern?

It looks like there's no issues between 10:31 and 12:15. Are there tracks for that period of time? What about after that?