idea Scraping Tool in Developers Ideas

Scraping Tool

JeffreyUtter2 — Tue, 06 Jun 2017 17:36:33 GMT

I would love to see a Scraping Tool from ESRI. This enables a person to go to any website and literally take any information from it, then convert it into a usable ESRI format such as Geojson, JSON, API, GDB or SHP file. In its process geocode any information and make it spatial.

Re: Scraping Tool

Lake_Worth_BeachAdmin — Thu, 15 Feb 2018 18:40:19 GMT

this has legal warnings all over it.

Re: Scraping Tool

SercanERHAN — Tue, 20 Feb 2018 12:54:10 GMT

Xpath scraping tool (connector) sounds great!

Re: Scraping Tool

DEWright_CA — Thu, 29 Mar 2018 18:12:39 GMT

Jeffrey Utter there are way better approaches to take. Safe FME Desktop/Server and the thinned our Data-Interop tools will let you do a lot of what you ask and even more. Yes, there is a increased cost but anything that ESRI would implement in this place would be a new development versus using well tested and developed tools.

Re: Scraping Tool

JeffreyUtter2 — Thu, 12 Apr 2018 21:16:32 GMT

Would you mind sharing your fmwt file with me?

Thanks.

Jeff

Re: Scraping Tool

DavidRunneals3 — Wed, 06 Jun 2018 19:51:08 GMT

AWS Glue, Python Scripting (ArcPy), Koop.JS, GeoEvent, and Geoprocessing services (executed via python script) are also potentials. Depends on the format that you're going to/from, if you need data transformation/processing in the middle, and the level of technical expertise that you're willing to put in. But I would say FME or the ArcGIS Data Interoperability Extension (lighter version of FME) is probably the most powerful and easiest to use.

Re: Scraping Tool

BruceHarold — Thu, 19 Jul 2018 18:08:57 GMT

Here is an example:

http://pm.maps.arcgis.com/home/item.html?id=9da0f8ae5fee45aca11bf77f712884c8

Re: Scraping Tool

José_LuisMartínez_Barba — Thu, 22 Jul 2021 16:00:19 GMT

también me encantaría, de echo es lo que estoy buscando hacer pero no lo he logrado, espero pronto se tenga la opción en ESRI. gracias