Scrape GIS data to find sites that match certain criteria

Question

I'm an architect (the building kind) that has been practicing open source architecture for a number of years.

All our 'blueprints' (CAD/BIM files) are open source and hosted on gitlab, github, and gitea.

We have a number of projects we've done in the past, (residences, multiple family, etc.).

Since we spent so much time developing these projects, it would be awesome if we could redevelopment them again, on another similar site.

The problem is, however, to manually find a site with the same (or similar) criteria (size of lot, setbacks, topography changes, density, etc.) as the original site would be near impossible.

Would be awesome if we could search/scrape GIS data to narrow down a list of candidate sites that matched the characteristics/criteria of the original site.

Relatively doable?

Perhaps a esri plugin?

Hayden Welch · Answer

If you're able to mirror the features you want in your own map, you can just use spatial queries pulled from your historical projects to pull data for that area. If their server supports REST queries, you can usually submit an extent and have it send you back features that are within that extent assuming you know the features you want to query.

You'll need the server rest url (usually https://<website>/arcgis/rest/services for a service directory). Definitely check the TOS for the data first or contact the GIS department that runs the server and see if they have any services you could use already set up.

From what I can see on that server you shared they have Parcel and Contour data and some tools for data export to ArcPro so it's definitely set up to do what you're asking.

VinceAngelo · Answer

That's a small enough set that you probably need to try it, though it still wouldn't meet your initial criteria, which included setbacks and topography.

There's also an issue with web scraping in general, since it's usually considered a violation of TOS for most web sites.

- V

theoryshaw · Answer

Thanks guys.

Specifically, this is the gis, in our area: https://dcimapapps.countyofdane.com/dcmapviewer/

Would there be enough here, I wonder.

What if you started with a very limited data set.  Just scraping lot size, land use, and land/tax value?