Latest Contributions by DanielFenton1

Hey Brian, the beta went live and we've got a short blog post that tells you what the features are and how to enable it. Enabling New Beta Search in ArcGIS Hub The feature should be out of beta w/in the next few months. As far as a newsletter, there is the ArcGIS Blog, linked about. There is also https://hub.arcgis.com/pages/changelog. We update the changelog every Tuesday when we release. ... View more

Hi Joel, looks like there is an error loading that web map, hence it would not show up in search. Is it still shared to your site. ... View more

Hi Joel, I think you may be searching incorrectly. When I search "site:http://geohub.brampton.ca parks" I get many results including pages, datasets and apps. I think you may be mislead by the portion of the url that includes `/datasets`. All types of content load under `/datasets`. We're working on improving those url fragment so they more closely represent the content type that is being loaded, but we do not have a timeline to share for that yet. We build a lot of features into our sites to make sure google can index well including sitemaps and metatags. We also conduct testing to ensure googlebot can load our pages and pay attention to load time affects page ranking. I recommend setting up Google Webmasters tools so you can get more direct insights into how Google is crawling your page and any errors that may be occurring. I hope this answers your question. Please let me know if my explanation does not make sense or fully answer your question. Daniel Fenton Software Engineer | ArcGIS Hub ... View more

Hi Dave, Thanks for your question! Let me first separate out two concepts, caching for downloads and indexing for search. To enable your users to easily search for and retrieve content from your sites, we store a set of metadata about each layer, csv, document etc in an index. To enable your users to download data in kml, csv, geojson, and shapefiles. We cache all features in every layer or table stored on your site in a filesystem. There are several reasons for using this cache. 1. ArcGIS Server does not support all of these export formats. Some are supported but only in certain configurations and versions of Server that are part of ArcGIS Enterprise and ArcGIS Online. This means that in order to offer these download formats, we must extract the raw data from your servers and run them through a translation process. You are correct that there are many ways to do this process. E.g. there are some javascript packages that can do this in the browser. However, the only software tool that is feature complete for this process that can handle many different kinds of source data is GDAL. That cannot be run in the browser. 2. Downloadable files may be extremely large, e.g. gigabytes. It takes a lot of computation to produce these files. It would not be efficient for every user to have to produce the transformation in their browser even if the shortcomings outlined above did not exist. 3. It's often a quite intensive operation to extract all the features from a Feature Service. As Server was not designed directly for this procedure, our systems have to find a way to query for all features one chunk at a time. If every user who requested a download had to go through this process, it would quickly overwhelm the servers providing the data. Last year, ArcGIS Hub server 12.3 million downloads. Some e.g. geojson extracts used by web applications, were download hundreds of thousands of times. 4.  "I think when people are downloading Open Data they can accept a longer wait. It proves that it is actually fetching new data." It's an interesting point, and we did used to have a process that would force users to wait for downloads to recache with new data. After receiving a lot of feedback from customers and users who felt the process was not a good user experience, we changed the procedure to only cache in the background. With that setting, we feel we can best serve users who come expecting a quick download. Our analytics also show that downloads increased significantly when we moved to this background caching process. With respect to issues users face with either our index and cache being out of date, we are currently working on the next generation of our indexing technology. That will be rolling out this year and should solve most of the issues users today face. We will also be able to apply this technology proactively detecting when downloads should be updated. Our challenge is that ArcGIS Server does not, by default, report when data has been updated. Server also does not notify our download system when data needs to change. There are some techniques we can apply to check in a lightweight way and we will be researching those this year. I'm sorry this process has been confusing for you. I hope I've been able to help you, and others better understand why our systems work they way they do. If not, please feel free to let me know! Daniel Fenton Lead Engineer for ArcGIS Hub Search and Downloads ... View more

Luke et al, We are still actively working on this as a top priority. We don't have an exact timeline to share yet. Daniel Fenton Software Engineer | ArcGIS Hub ... View more

I’m sorry, but there is nothing new to report at this time. Daniel Fenton Software Engineer | ArcGIS Hub ... View more

We had a subtle bug in our download system that was causing this error. It has been resolved so you should not see it anymore. I verified that the link you provided does not show this error anymore. ... View more

Hi Matt, I believe this class of issues has been resolved. I'm sorry about the ambiguous error message. There was a subtle bug in our download system that had to be worked out. ... View more

Hi Jeff, which providers are you trying to set up? Have you been through this document? Setup  ... View more

Hi Chaya, Would you please open a ticket with support? They can help you determine the exact steps to reproduce the issues you are facing. From there it's much easier for our developers to solve the problem. Thanks, Daniel Fenton ArcGIS Hub Team ... View more

Hi Natalie, I recommend opening up an issue with support so they can precisely scope the issue and further escalate to developers if necessary. Daniel Fenton ArcGIS Hub Team ... View more

Ok. This error is in our download system and not your ArcGIS server. We will look into it. ... View more