topic Re: Import OSM Data to ArcGis does not work in Data Management Questions

Import OSM Data to ArcGis does not work

AlexanderDunkel — Thu, 20 Oct 2011 18:08:21 GMT

I am having problems importing .osm (OpenStreetMap) Data to ArcGis. Using the Quick Data Import, I get the following result:

Messages
Executing: QuickImport OSM,LOCALPATH\map.osm,"RUNTIME_MACROS,""SCHEMA_CHOICE,""""OSM Community Approved Feature Types"""",COMMUNITY_FEATURE_TYPES,BROAD,CUSTOM_OSM_PIPELINE,<Unused>,CLOSE_AREAS,yes,CUSTOM_AREA,NO,CUSTOM_AREA_FEATURES,<Unused>,_MERGE_SCHEMAS,YES"",META_MACROS,""SourceSCHEMA_CHOICE,""""OSM Community Approved Feature Types"""",SourceCOMMUNITY_FEATURE_TYPES,BROAD,SourceCUSTOM_OSM_PIPELINE,<Unused>,SourceCLOSE_AREAS,yes,SourceCUSTOM_AREA,NO,SourceCUSTOM_AREA_FEATURES,<Unused>"",METAFILE,OSM,COORDSYS,,IDLIST,,__FME_DATASET_IS_SOURCE__,true" LOCALPATH\map2
Start Time: Thu Oct 20 11:56:06 2011
Using translation engine build 6213.
Starting Import
QuickImport log results will be reported in file: C:\Users\Studio1535\AppData\Roaming\Safe Software\Interoperability\logs\interop-log-20111020-115606-ArcSOCP-a03712-QuickImport_001.log
Feature Manipulation Engine 2010 (ESRI DESKTOP) (20100329 - Build 6213 - WIN32)
Data Interoperability (node locked-crc)
Permanent License.
Machine host name is: Studio1535-PC
Opening OSM reader for dataset LOCALPATH\map.osm
Loaded module 'OSM' from file 'LOCALPATHESRI\Data Interoperability Extension\plugins/OSM.dll'
FME API version of module 'OSM' matches current internal version (3.6 20090807)
Opening GEODATABASE_FILE writer for dataset LOCALPATH\map2
Loaded module 'GEODATABASE_FILE' from file 'LOCALPATHESRI\Data Interoperability Extension\GEODATABASE9.dll'
FME API version of module 'GEODATABASE_FILE' matches current internal version (3.6 20090807)
FME Configuration: No destination coordinate system set
Reading schema features
FME API version of module 'OSM' matches current internal version (3.6 20090807)
Loaded module 'XML' from file 'LOCALPATHESRI\Data Interoperability Extension\plugins/XML.dll'
FME API version of module 'XML' matches current internal version (3.6 20090807)
Using Dynamic Reader $Revision: 62876 $ ( $Date: 2009-08-27 11:28:55 -0700 (Thu, 27 Aug 2009) $ ) with module XML to read data from dataset `LOCALPATH\map.osm'
The XML Reader is using xfMap 'LOCALPATHESRI\Data Interoperability Extension\xml\osm\osm_xfmap.xml'
Pre-processing xfMap 'LOCALPATHESRI\Data Interoperability Extension\xml\osm\osm_xfmap.xml' with macro stylesheet 'LOCALPATHESRI\Data Interoperability Extension\/xfmap/xfmap_macro.xslt'.
XML Reader mapped feature # 2000
XML Reader mapped feature # 4000
XML Reader mapped feature # 6000
XML Reader mapped feature # 8000
XML Reader mapped feature # 10000
XML Reader mapped feature # 12000
XML Reader mapped feature # 14000
XML Reader mapped feature # 16000
XML Reader mapped feature # 18000
XML Reader mapped feature # 20000
XML Reader mapped feature # 22000
XML Reader mapped feature # 24000
OSMPipeline::MakeLinesFromPoints(ReferenceFactory): Completed 100% of intermediate processing
OSMPipeline::MakeLinesFromPoints(ReferenceFactory): Completed 100% of intermediate processing
OSMPipeline::MakeLinesFromPoints(ReferenceFactory): Total Results: 3841 Complete Feature(s), 0 Incomplete Feature(s), 19184 Referenced Feature(s), 2266 Unreferenced Feature(s), 0 Referencer Feature(s) (NO REFERENCES), 0 Referencee Feature(s) (NO Referencee fields defined), and 0 Duplicate Referencee Feature(s)
OSMPipeline::FillInDefinedAreas(TestFactory): Tested 3841 input features -- 68 features passed, 3773 features failed.
OSMPipeline::relation_multipolygon_filter(TestFactory): Tested 293 input features -- 92 features passed, 201 features failed.
OSMPipeline::relation_route_filter(TestFactory): Tested 201 input features -- 63 features passed, 138 features failed.
OSMPipeline::relation_restriction_filter(TestFactory): Tested 138 input features -- 90 features passed, 48 features failed.
OSMPipeline::Ref_RelationMultiPolygon(ReferenceFactory): Completed 100% of intermediate processing
OSMPipeline::Ref_RelationMultiPolygon(ReferenceFactory): Completed 100% of intermediate processing
OSMPipeline::Ref_RelationMultiPolygon(ReferenceFactory): Total Results: 66 Complete Feature(s), 26 Incomplete Feature(s), 206 Referenced Feature(s), 25085 Unreferenced Feature(s), 0 Referencer Feature(s) (NO REFERENCES), 0 Referencee Feature(s) (NO Referencee fields defined), and 0 Duplicate Referencee Feature(s)
OSMPipeline::OSM_RemoveTempAttributes(SamplingFactory): Sampled 25291 of 25291 feature(s)
OSMPipeline::highway_filter(TestFactory): Tested 25291 input features -- 22953 features passed, 2338 features failed.
OSMPipeline::cycleway_filter(TestFactory): Tested 22953 input features -- 22953 features passed, 0 features failed.
OSMPipeline::tracktype_filter(TestFactory): Tested 22953 input features -- 22953 features passed, 0 features failed.
OSMPipeline::waterway_filter(TestFactory): Tested 22953 input features -- 22946 features passed, 7 features failed.
OSMPipeline::railway_filter(TestFactory): Tested 22946 input features -- 22555 features passed, 391 features failed.
OSMPipeline::aeroway_filter(TestFactory): Tested 22555 input features -- 22555 features passed, 0 features failed.
OSMPipeline::aerialway_filter(TestFactory): Tested 22555 input features -- 22555 features passed, 0 features failed.
OSMPipeline::power_filter(TestFactory): Tested 22555 input features -- 22547 features passed, 8 features failed.
OSMPipeline::man_made_filter(TestFactory): Tested 22547 input features -- 22428 features passed, 119 features failed.
OSMPipeline::leisure_filter(TestFactory): Tested 22428 input features -- 22316 features passed, 112 features failed.
OSMPipeline::buidling_filter(TestFactory): Tested 22316 input features -- 22316 features passed, 0 features failed.
OSMPipeline::amenity_filter(TestFactory): Tested 22316 input features -- 21312 features passed, 1004 features failed.
OSMPipeline::shop_filter(TestFactory): Tested 21312 input features -- 21057 features passed, 255 features failed.
OSMPipeline::tourism_filter(TestFactory): Tested 21105 input features -- 21012 features passed, 93 features failed.
OSMPipeline::historic_filter(TestFactory): Tested 20964 input features -- 20937 features passed, 27 features failed.
OSMPipeline::landuse_filter(TestFactory): Tested 20937 input features -- 20864 features passed, 73 features failed.
OSMPipeline::military_filter(TestFactory): Tested 20864 input features -- 20864 features passed, 0 features failed.
OSMPipeline::natural_filter(TestFactory): Tested 20864 input features -- 20769 features passed, 95 features failed.
OSMPipeline::route_filter(TestFactory): Tested 20769 input features -- 20768 features passed, 1 feature failed.
OSMPipeline::boundary_filter(TestFactory): Tested 20768 input features -- 20742 features passed, 26 features failed.
OSMPipeline::sport_filter(TestFactory): Tested 20742 input features -- 20732 features passed, 10 features failed.
OSMPipeline::abutters_filter(TestFactory): Tested 20732 input features -- 20732 features passed, 0 features failed.
OSMPipeline::place_filter(TestFactory): Tested 20732 input features -- 20726 features passed, 6 features failed.
OSMPipeline::CloseUndefinedAreas(TestFactory): Tested 1796 input features -- 340 features passed, 1456 features failed.
50 features scanned
100 features scanned
150 features scanned
200 features scanned
250 features scanned
[...]
24250 features scanned
25550 features scanned
Merged 22 schema features read from 1 datasets into 22 resulting feature types
Read 22 schema features
Reading features
FME API version of module 'XML' matches current internal version (3.6 20090807)
Using Dynamic Reader $Revision: 62876 $ ( $Date: 2009-08-27 11:28:55 -0700 (Thu, 27 Aug 2009) $ ) with module OSM to read data from dataset `LOCALPATH\map.osm'
Using Dynamic Reader $Revision: 62876 $ ( $Date: 2009-08-27 11:28:55 -0700 (Thu, 27 Aug 2009) $ ) with module XML to read data from dataset `LOCALPATH\map.osm'
The XML Reader is using xfMap 'LOCALPATHESRI\Data Interoperability Extension\xml\osm\osm_xfmap.xml'
Pre-processing xfMap 'LOCALPATHESRI\Data Interoperability Extension\xml\osm\osm_xfmap.xml' with macro stylesheet 'LOCALPATHESRI\Data Interoperability Extension\/xfmap/xfmap_macro.xslt'.
XML Reader mapped feature # 2000
XML Reader mapped feature # 4000
[...]

Re: Import OSM Data to ArcGis does not work

AlexanderDunkel — Thu, 20 Oct 2011 18:08:56 GMT

XML Reader mapped feature # 24000
OSMPipeline::MakeLinesFromPoints(ReferenceFactory): Completed 100% of intermediate processing
OSMPipeline::MakeLinesFromPoints(ReferenceFactory): Completed 100% of intermediate processing
OSMPipeline::MakeLinesFromPoints(ReferenceFactory): Total Results: 3841 Complete Feature(s), 0 Incomplete Feature(s), 19184 Referenced Feature(s), 2266 Unreferenced Feature(s), 0 Referencer Feature(s) (NO REFERENCES), 0 Referencee Feature(s) (NO Referencee fields defined), and 0 Duplicate Referencee Feature(s)
OSMPipeline::FillInDefinedAreas(TestFactory): Tested 3841 input features -- 68 features passed, 3773 features failed.
OSMPipeline::relation_multipolygon_filter(TestFactory): Tested 293 input features -- 92 features passed, 201 features failed.
OSMPipeline::relation_route_filter(TestFactory): Tested 201 input features -- 63 features passed, 138 features failed.
OSMPipeline::relation_restriction_filter(TestFactory): Tested 138 input features -- 90 features passed, 48 features failed.
OSMPipeline::Ref_RelationMultiPolygon(ReferenceFactory): Completed 100% of intermediate processing
OSMPipeline::Ref_RelationMultiPolygon(ReferenceFactory): Completed 100% of intermediate processing
OSMPipeline::Ref_RelationMultiPolygon(ReferenceFactory): Total Results: 66 Complete Feature(s), 26 Incomplete Feature(s), 206 Referenced Feature(s), 25085 Unreferenced Feature(s), 0 Referencer Feature(s) (NO REFERENCES), 0 Referencee Feature(s) (NO Referencee fields defined), and 0 Duplicate Referencee Feature(s)
OSMPipeline::OSM_RemoveTempAttributes(SamplingFactory): Sampled 25291 of 25291 feature(s)
OSMPipeline::highway_filter(TestFactory): Tested 25291 input features -- 22953 features passed, 2338 features failed.
OSMPipeline::cycleway_filter(TestFactory): Tested 22953 input features -- 22953 features passed, 0 features failed.
OSMPipeline::tracktype_filter(TestFactory): Tested 22953 input features -- 22953 features passed, 0 features failed.
OSMPipeline::waterway_filter(TestFactory): Tested 22953 input features -- 22946 features passed, 7 features failed.
OSMPipeline::railway_filter(TestFactory): Tested 22946 input features -- 22555 features passed, 391 features failed.
OSMPipeline::aeroway_filter(TestFactory): Tested 22555 input features -- 22555 features passed, 0 features failed.
OSMPipeline::aerialway_filter(TestFactory): Tested 22555 input features -- 22555 features passed, 0 features failed.
OSMPipeline::power_filter(TestFactory): Tested 22555 input features -- 22547 features passed, 8 features failed.
OSMPipeline::man_made_filter(TestFactory): Tested 22547 input features -- 22428 features passed, 119 features failed.
OSMPipeline::leisure_filter(TestFactory): Tested 22428 input features -- 22316 features passed, 112 features failed.
OSMPipeline::buidling_filter(TestFactory): Tested 22316 input features -- 22316 features passed, 0 features failed.
OSMPipeline::amenity_filter(TestFactory): Tested 22316 input features -- 21312 features passed, 1004 features failed.
OSMPipeline::shop_filter(TestFactory): Tested 21312 input features -- 21057 features passed, 255 features failed.
OSMPipeline::tourism_filter(TestFactory): Tested 21105 input features -- 21012 features passed, 93 features failed.
OSMPipeline::historic_filter(TestFactory): Tested 20964 input features -- 20937 features passed, 27 features failed.
OSMPipeline::landuse_filter(TestFactory): Tested 20937 input features -- 20864 features passed, 73 features failed.
OSMPipeline::military_filter(TestFactory): Tested 20864 input features -- 20864 features passed, 0 features failed.
OSMPipeline::natural_filter(TestFactory): Tested 20864 input features -- 20769 features passed, 95 features failed.
OSMPipeline::route_filter(TestFactory): Tested 20769 input features -- 20768 features passed, 1 feature failed.
OSMPipeline::boundary_filter(TestFactory): Tested 20768 input features -- 20742 features passed, 26 features failed.
OSMPipeline::sport_filter(TestFactory): Tested 20742 input features -- 20732 features passed, 10 features failed.
OSMPipeline::abutters_filter(TestFactory): Tested 20732 input features -- 20732 features passed, 0 features failed.
OSMPipeline::place_filter(TestFactory): Tested 20732 input features -- 20726 features passed, 6 features failed.
OSMPipeline::CloseUndefinedAreas(TestFactory): Tested 1796 input features -- 340 features passed, 1456 features failed.
FME Configuration: Source coordinate system for reader R_1[OSM] set to `LL84' as read from input data
Coordinate System `LL84' parameters: CS_NAME=`LL84' DESC_NM=`WGS84 datum, Latitude-Longitude; Degrees' DT_NAME=`WGS84' EPSG=`4326' GROUP=`LL' MAP_SCL=`1' PROJ=`LL' QUAD=`1' SCL_RED=`1' SOURCE=`Mentor Software' UNIT=`DEGREE'
Coordinate System `LL84' as OGC Well Known Text: GEOGCS["WGS84 datum, Latitude-Longitude; Degrees",DATUM["WGS_1984",SPHEROID["World Geodetic System of 1984, GEM 10C",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]]
Using Dynamic Writer $Revision: 26873 $ ( $Date: 2006-03-01 10:08:47 -0800 (Wed, 01 Mar 2006) $ ) with module GEODATABASE_FILE to write dataset `LOCALPATHmap2'
FME API version of module 'GEODATABASE_FILE' matches current internal version (3.6 20090807)
FME API version of module 'GEODATABASE_FILE' matches current internal version (3.6 20090807)
This Geodatabase Reader/Writer module has been built using ArcGIS 9 libraries
An ArcGIS license is already checked out. The product checked out is 'ArcInfo'
Created and connected to the ArcGIS 10.0 File Geodatabase at 'LOCALPATHmap2'
All errors encountered while writing features will be ignored as directed by the '_IGNORE_FAILED_FEATURE_ENTRY' keyword
The 'HAS_Z_VALUES' keyword is set to 'AUTO_DETECT'. With the exception of MultiPatch feature classes, the dimensionality of new feature classes will be based on the first feature written to the feature class. (Features with no geometry are considered 2D)
A default z-value of '0' will be used for all 3D features where z-values are not provided
Geodatabase Writer: Not simplifying geometries being written to the Geodatabase
Writer mode is 'INSERT'
Transactions are being used by the Geodatabase Writer
FME Configuration: Destination coordinate system set to input coordinate system `LL84'
Geodatabase Writer: Creating table/feature class `relation_restriction'
Transaction #1 was successfully committed
Geodatabase Writer: Creating table/feature class `relation_route'
An error occurred while attempting to create the table 'relation_route'. The error number from ArcObjects is: '-2147219886'. The error message from ArcObjects is: {The table was not found. [relation_restriction]}
A fatal error has occurred. Check the logfile above for details
GeodatabaseRelationshipFeaturesPipeline::GeodatabaseRelationshipFeatures(SortFactory): Sorted 0 feature(s)
Transaction #2 (final transaction) was successfully committed
Closing the Geodatabase writer
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Feature output statistics for `GEODATABASE_FILE' writer using keyword `W_1':
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Features Written
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
relation_restriction 1
relation_route 1
==============================================================================
Total Features Written 2
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
FME Session Duration: 31.8 seconds. (CPU: 24.8s user, 1.9s system)
END - ProcessID: 4516, peak process memory usage: 196424 kB, current process memory usage: 190008 kB.

Failed to copy features (1): A fatal error has occurred. Check the logfile above for details
Program Terminating

Translation FAILED.
Tool execution failed.
Done Import. Read 2 features.
Failed to execute (QuickImport).
Failed at Thu Oct 20 11:56:43 2011 (Elapsed Time: 37.00 seconds)

I tried different .osm files, everytime the same error

also tried differet tools for osm - shp conversion, all did not work: osm2shp, Osmium, ...

OpenStreepMap ToolBox cannot load .osm files either! (Version 1.1, Version 2.0 beta)

I have SP1 installed

There must be a reason why all these programs don't work for me. Does anyone have any suggestion where I could look for help?
Thank you, Helmut

Re: Import OSM Data to ArcGis does not work

ChristineWhite — Mon, 02 Apr 2012 15:30:14 GMT

Hello Helmut,
I am on the ArcGIS Editor for OSM team, and would like to find out more about the Load OSM File tool not working for you. What .osm file are you attempting to load? What errors do you get when you run the Load OSM File tool from the OpenStreetMap Toolbox?

Many thanks!

Christine

Re: Import OSM Data to ArcGis does not work

Luiz_AmadeuCoutinho — Wed, 04 Apr 2012 13:45:05 GMT

Hi.

But when try Load OSM Data, I am receive the error " Unable to complete polygon geometry due to undetermined nodes" part os data dont is loaded.

In Symbolize OSM Data tool dont work in Polygon Layer , I receive the error "error 000800 The value is not a member of..."

For Line and Points works perfectly

I´m use OSM Editor 2.0 and ArcGIS Desktop SP4

OSM Data from cloudmade downloads > South America > Brazil > Espirito Santo

Re: Import OSM Data to ArcGis does not work

ChristineWhite — Wed, 04 Apr 2012 17:44:59 GMT

Hello Luiz,
I was able to run the Load OSM File tool on the espirito_santo.administrative.osm dataset downloaded from the cloudmade downloads site. Is that the same OSM file that you are attempting to load (I see there are several in the Espiritu Santo folder)? If not, which one from that site did you use?

Next question: when you run the Load OSM File tool, you must specify a feature dataset location into which the .osm file is translated. Was that feature dataset in a local file geodatabase, or in an SDE geodatabase? If in SDE, what RDBMS (e.g., postgresql, oracle, or sql server) are you using?

I want to replicate your exact steps - I used a local (not-SDE) geodatabase and it worked ok. After loading the file, I used the 'Symbolize OSM Data' tool to symbolize the feature classes, and it worked again without problems. So I want to hear from you these details so we can identify where the problem is occurring.

Many thanks,

Christine

Re: Import OSM Data to ArcGis does not work

AngelaCimini — Mon, 04 Sep 2023 19:38:02 GMT

Hello Christine,
first of all, I am new to the world of arcgis editor for osm. I need to use the load osm tool for the whole of italy because I need to create a routable network, however I can only fully load the nodes and the pc crashes at about 15% of loading ways. Can you give me any suggestions to solve this problem?
I thank you for your support