topic Where to Subscribe to Live Traffic Data and Adding Another Provider in ArcGIS Network Analyst Questions

Where to Subscribe to Live Traffic Data and Adding Another Provider

FilipJung — Tue, 11 Sep 2012 08:51:59 GMT

Hi,
I have a question regarding web services used to distribute Live Traffic data and generating DTF files. I have tried to look for this services both on NAVTEQ and TomTom websites and have not found anything.
I think that in documentation could be mentioned what type of service is it, so it could be easily searched. I tried to listen to web communication but target URLs have not given me any useful info.
Is it then some special service, which is not mentioned in Services/Products on provider's pages?

And another question is if would be posible to add our own service to list in Update Traffic Data Tool (do some configuration). Or is it only limited to listed providers? I am asking since our region is not in provided and we could have posibility to make such a service of our own.

Or would it be possible to make DTF file by ourselves?

Thanks much for answers and help.

Filip

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

PatrickStevens — Wed, 12 Sep 2012 15:03:16 GMT

Hi,
I have a question regarding web services used to distribute Live Traffic data and generating DTF files. I have tried to look for this services both on NAVTEQ and TomTom websites and have not found anything.
I think that in documentation could be mentioned what type of service is it, so it could be easily searched. I tried to listen to web communication but target URLs have not given me any useful info.
Is it then some special service, which is not mentioned in Services/Products on provider's pages?

The Update Traffic tools for incidents and speed data downloads are configured for NavTeq and TomTom already. If you have a user name and password from those vendors, you can enter that in the GP tool. Then, you'll be able to use a traffic enabled network dataset with the downloaded data.

To see the URLs used for the downloads, you can peek into the TrafficProviders.xml file. It is at:

<ArcGIS Install Directory>\NetworkAnalyst\NetworkConfiguration\TrafficProviders.xml

For me, that is:

C:\Program Files (x86)\ArcGIS\Desktop10.1\NetworkAnalyst\NetworkConfiguration\TrafficProviders.xml

And another question is if would be posible to add our own service to list in Update Traffic Data Tool (do some configuration). Or is it only limited to listed providers? I am asking since our region is not in provided and we could have posibility to make such a service of our own.

Or would it be possible to make DTF file by ourselves?

Instructions for adding your service to the Update Traffic tool is here:

http://www.arcgis.com/home/item.html?id=e11126ea20e941bd9644046e62e2bdbe

If you have any trouble with using the tool, post here and I'll help out.

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

FilipJung — Thu, 13 Sep 2012 05:03:22 GMT

Dear Patrick,
thanks much for your help! I will try adding custom provider as described in sample you provided. I believe that with this you have taken a thorn out of my flesh. I will let you know when I manage to use it.
Filip

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

FilipJung — Thu, 13 Dec 2012 07:05:54 GMT

Dear Patrick,
I finally got myself to implement our CustomTrafficProvider. I get data from database so I adjusted code for that. Everything runs OK (data are loaded from DB, trafficRegionSpeedsStruct created and added to m_trafficRegionSpeedsList) but tool ends with this error:

ERROR 030103: Failed to update traffic data.
Invalid function arguments
Invalid function arguments
Failed to execute (UpdateTrafficData).

Do you have an idea of what could be wrong? I'm catching errors in code, but this error seems not to be in my code, since it is raised after all classes instances are created.

Thanks for help.

Filip

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

FilipJung — Thu, 13 Dec 2012 11:59:12 GMT

I'm sorry for false alarm, which it was, at least partially.
The cause was, that we had bad format TMC codes in our source database. After correcting to the right syntax, the tool runs successfully and the DTF file along with the TrafficIndex file are generated.

But in ArcMap, we do not see Live Traffic in our ND symbology, though we had time set up along with right time zone.
Is there any way to check that our DTF file is correct? Could it be problem that we write only one TimeSlice into m_timeSlices and only one speed speed in timeSliceSpeeds? Which means that we do not have predicted speeds.

Thanks for help.

Filip

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

PatrickStevens — Thu, 13 Dec 2012 16:13:01 GMT

Getting the traffic to display in ArcMap can be a bit tricky. You need to make sure that you have time enabled on the map and that the time settings are correct.

I'm probably missing some steps, but the general idea to check your traffic display is:

Make sure your network dataset layer is in the map, and set to display live traffic only (no historical).

Open up the time slider by clicking the little clock button on the main toolbar

Click the options button on the time slider

On the Time Display tab, be sure to correctly set your time zone. This is very important.

On the Time Extent tab, I usually set the full time extent to <Undefined>, then fill in a start and end time that more than covers the extent of my traffic data.

Here is a very important part: The DTFs and TrafficIndex.xml files all use UTC time. Check inside TrafficIndex.xml and look at the time that is the DTF file name. If you have properly set your time zone on the time slider, you should see live traffic if the time slider time is offset by the proper amount from UTC.

A quick test is to set the time zone on the slider to UTC, then set the time to be just after the start time of one of your DTFs.

I hope this helps,

Patrick

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

FilipJung — Fri, 14 Dec 2012 08:08:28 GMT

Hi Patrick,
I tried the way that you described but was not successfull even when playing with time settings in many ways.

When I checked my TrafficIndex.xml file, all time values seemed to by in our local time (UTC +1). I suppose that it is caused by setting m_timestamp = DateTime.Now in EnumTrafficSpeeds. So I converted DateTime.Now using ToUniversalTime() and times in TrafficIndex.xml file and also name of created dtf file changed to UTC time. Unfortunately not even this helped to bring the live data into display.

One thing that I discovered is that if I set the time on in ArcMap and go to the time covered by my DTF file and then try to delete that DTF file on disk, there is a protection against deleting even for an administrator. After ArcMap is closed I was able to delete the file. So this could probably prove that DTF file is accesed by ArcMap, but as it seems, no values are loaded from it. I'm quiet sure, that TMC codes and speeds are correct.

Do you know about any reason why it does not work?

Thanks.

Filip

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

PatrickStevens — Mon, 17 Dec 2012 16:25:42 GMT

Hello, Filip,

Do you think I could see your TrafficIndex.xml and an associated DTF? If so, please zip it up and send it to pstevens at esri.com.

I'm not sure if the problem is in the traffic files, in the ArcMap time settings, or in the network dataset traffic tables. If I don't see anything obvious in the traffic files, we'll take a look at the network.

Also, if you need a fast response, you can contact support.

Thanks, and sorry that you are having such difficulties!

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

PatrickStevens — Thu, 20 Dec 2012 21:04:48 GMT

Filip and I worked out the issues and his traffic information is working correctly now. To summarize the important points:

- Be sure your TMC codes are 9 characters long with the following formatting:

   TMC is encoded as ABBCDDDDD
   A - Country code
   BB - Region code
   C - One character RDS direction: + - P N
   DDDDD - Location code

   Make sure that the A value is not zero.

- There are issues (before 10.1 SP2) with traffic data written in one date format (for example MM/DD/YYYY), then read in another format (DD/MM/YYYY).   SP2 will fix it, but prior to that, be sure to read and write in the same format.

- The ITrafficProvider API does not currently allow for setting the speed units to anything other than MPH. I'm not sure when this will be fixed. In the meantime, there are a couple of workarounds if you are using KPH:

   1) Manually convert the value in your feed from KPH to MPH before feeding it into the UpdateTraffic GP tool. If your network is in KPH, the coversion from MPH in traffic files to KPH in the solver will happen automatically.

   2) Use the ITrafficDataManager API instead of ITrafficProvider. What you gain is flexibility in how the traffic files are written, including setting the speed units. What you lose is the ability to get your custom provider in the UpdateTraffic GP tool.

- VERY IMPORTANT. As of now (not sure when it will be fixed), you are required to have historical traffic data to use live traffic. If you don't have it, you have to fake it. To fake it, you need a profiles table with 1 profile. Set the scale factor for each time slice to 1.   You also need a Streets_Profiles join table to assign your fake profile to every street (as well as provide a base speed for the street segment). Check out the San Diego tutorial data to see how it should all look.

--------------------------
Whew! That is a lot of stuff. Live traffic is really built to be used with supported vendor data. To get it working with custom proprietary data takes some strange workarounds. As people try this, when they have problems, please post them either in this thread or in a new forum thread.

Thanks!

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

BrittanyBurson2 — Fri, 11 May 2018 23:31:17 GMT

Hello Patrick, I've been looking around the web for some kind of data dictionary or schema for the TMC codes -- for example you state the TMC is encoded as ABBCDDDDD, where A = Country code and BB = Region code. I can't seem to find a reference of what codes to use anywhere, but I see in the network dataset tutorial data uses 106 for San Diego. Is there a list of country or region codes documented somewhere?

Thank you!

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

PatrickStevens — Mon, 14 May 2018 16:26:17 GMT

I asked around a bit and I think the TMC information is available from data documentation provided by traffic data providers, which has to be requested from the data providers (like Here or TomTom). So, unfortunately, that kind of documentation isn't available for the tutorial data. Sorry!

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

PatrickStevens — Mon, 14 May 2018 21:10:44 GMT

It looks like your question was edited after I had received it, so I might not have answered your new question. For that one: Is there a list of country or region codes documented somewhere?

The 106 you see for San Diego is the country and region code that HERE (the data provider of our tutorial data) uses in their traffic feeds for the San Diego area. But a different traffic feed provider for San Diego might not use 106.

Contact your traffic feed provider for the list of countries and regions that they use.

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

BrittanyBurson2 — Tue, 22 May 2018 20:00:00 GMT

Hi Patrick, thanks for your reply, lucky for us you are still at ESRI. So it sounds like if we are generating our own traffic feed provider those values can vary and aren't baked into the ESRI code. We are currently faking the historical data tables in order to use live traffic feed updates, which works well, but I'm fuzzy on the proper order of operations to update/add street segments after that. Would one manually add a new record into the TMC table to match the new street ID of a new segment in the street network, then rebuild? If I add a new street segment currently, it will not "absorb" it into the network dataset when I rebuild, which I think is because it has no related match yet in the TMC table. Appreciate any suggestions you may have, and thank you.

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

PatrickStevens — Wed, 23 May 2018 16:16:20 GMT

Without going off and trying it myself, your steps sound correct. Add the street, add an entry in the TMC tables, rebuild.

Perhaps a full rebuild is required, instead of an incremental rebuild. Try to trick the build engine into thinking the whole network needs a rebuild, then do a build. Like this:

Add an attribute, called whatever you want.

Click apply.

Delete the attribute you just added.

Click apply.

Build the network.

Then see if the new segment works with your live traffic. I think there might be a problem in the network dataset where updates to the traffic tables don't trigger a full rebuild. Let me know if the above steps work for you.

Re: Where to Subscribe to Live Traffic Data and Adding Another Provider

MUSTAFAALIGOKKAYA — Wed, 17 Nov 2021 05:39:50 GMT

Hi Patrick, I really appreciated your helps here, took benefit of it a lot. I have a question about servicing this live traffic on arcgis server that we could display on map as a live traffic, we can only display historical traffic data. But we can display and route network on arcgis pro. What could it be done on arcgis server to display and serve the live traffic data exactly. Also we store network dataset on enterprise geodatabase 10.8.1 in Oracle and publish it on ArcGIS Server 10.8 or 10.9 by using ArcGIS Pro 2.8