Is there a way to view Socrata data on an ArcGIS Online map?

[AndrewRudin]

Is there a way to view Socrata data on an ArcGIS Online map?  I want to view the Socrata data as a live feed and not have to make a copy of the data on AGOL for it to work.  The Socrata data is exposed as a .JSON file.  Here is an example dataset:   https://data.austintexas.gov/Government/Austin-Animal-Center-Found-Pets-Map/hye6-gvq2

And the example's rest endpoint is:  https://data.austintexas.gov/resource/hye6-gvq2.json 

Was also hoping to do this all through the AGOL interface and not have to use ESRI's javascript API to make this happen.

The reason I ask is,  Socrata is the City of Austin's open data platform.  I'm trying to come up with a means for the general ArcGIS Online users to incorporate datasets they discover on Socrata into the maps they are creating.  These users usually have little to no programming experience so something through the AGOL interface is ideal.

Thanks for any help you can provide,

Andrew

[Anonymous User]

Sorry for the late reply, but I just had the same question and maybe what I found could still be helpful.

Esri has an ETL engine called Koop that can convert data into a lot of different formats as well as make resources from other platforms work in ArcGIS Online. There is a provider written for Socrata resources that might help in this specific use case.

Definitely check out the docs, but using your example dataset, here's what the URL would look like: http://koop.dc.esri.com/socrata/austex/hye6-gvq2/FeatureServer/. 

Now you can load that data into a web map that would look familiar to the users you're thinking of:

The functionality of services registered this way may not be as complete as one registered via file upload, but try it out. Koop is an open source project so if there's any functionality you find missing, feel free to open an issue.

Hope that helps!

#koop‌ #etl‌ #spatial etl‌ #etl tools‌ #spatial etl tool‌ #socrata‌

[Jackson_CountyMissouri]

Is Koop Socrata dead? I have looked on github and the last update has been two years. We are looking at using this but have run into some issues. 

Microsoft Windows [Version 10.0.14393]
(c) 2016 Microsoft Corporation. All rights reserved.

C:\Users\gisadmin>cd C:\Users\gisadmin\demo-app22

C:\Users\gisadmin\demo-app22>npm install koop-socrata --save
npm WARN deprecated ejs@1.0.0: Critical security bugs fixed in 2.5.5
npm WARN deprecated sphericalmercator@1.0.5: This module is now under the @mapbox namespace: install @mapbox/sphericalmercator instead
npm WARN deprecated minimatch@1.0.0: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated natives@1.1.6: This module relies on Node.js's internals and will break at some point. Do not use it, and update to graceful-fs@4.x.
+ koop-socrata@1.0.4
updated 1 package and audited 1694 packages in 9.554s
found 8 vulnerabilities (2 low, 6 high)
  run `npm audit fix` to fix them, or `npm audit` for details

C:\Users\gisadmin\demo-app22>npm audit fix
up to date in 3.828s
fixed 0 of 8 vulnerabilities in 1694 scanned packages
  8 vulnerabilities required manual review and could not be updated

C:\Users\gisadmin\demo-app22>npm install ejs
+ ejs@2.7.1
updated 1 package and audited 1695 packages in 4.703s
found 8 vulnerabilities (2 low, 6 high)
  run `npm audit fix` to fix them, or `npm audit` for details

C:\Users\gisadmin\demo-app22>npm audit

                       === npm audit security report ===


                                 Manual Review
             Some vulnerabilities require your attention to resolve

          Visit https://go.npm.me/audit-guide for additional guidance


  High            Regular Expression Denial of Service

  Package         minimatch

  Patched in      >=3.0.2

  Dependency of   koop-socrata

  Path            koop-socrata > ogr2ogr > archiver > glob > minimatch

  More info       https://npmjs.com/advisories/118‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

[joerodmey]

Andrew Rudin Jackson County Missouri Patrick Hammons I too am interested in connecting to Socrata via AGOL. Is the above mentioned process still possible? If not any other options to connect?

[LisaCasey]

Same here - hoping there can be a solution for this

[Sarah_Hanson]

Hi there! You can use ArcGIS Data Pipelines to connect to files from a public URL, and easily bring that data into ArcGIS Online for visualization and analysis workflows. I have seen many users doing this with Socrate open data portals. Hope that info helps!