Latest Contributions by NoahSlocum

Hi Claire,  We haven't seen any recent issues related to overwrite, or regarding duplicate records. If you are still able to reproduce these issues, could you share more information about your workflow? We would be interested in the geometry type, the number of rows you're trying to write, the number of rows in the layer you're overwriting, and anything else that might help us reproduce the issues in-house. A sample of your data or other data that can reproduce the issues would be even better. Also, if you can share a specific date when these issues started that would be helpful. Feel free to reach out to us at [email protected] to continue this discussion over email if that's easier. Best regards, Noah ... View more

Hi Matthew, here are some thoughts on this workflow: Ingesting GIS data - GeoAnalytics Engine supports reading from various GIS data sources, see https://developers.arcgis.com/geoanalytics/data/data-sources/ for a complete list. In this case I assume you would be reading from something like a Feature Service, or local data like a file geodatabase, both of which are supported. Writing Parquet - This is pretty straightforward with GeoAnalytics Engine, you could also choose to write GeoParquet.  Building SQL views that can integrate with ArcGIS Enterprise/SDE - You can create SQL views on parquet files stored in your Data Lake, but those SQL views can only be used within Azure Synapse, they can't be used by your Enterprise SDE database as far as I know. There are a few workflows that might be viable (in both cases, this step would be independent of writing Parquet to your Data Lake): Use Geoanalytics Engine to write directly to your Enterprise SDE database using JDBC. You could then create feature and map services backed by this database. Publish hosted features services directly to ArcGIS Enterprise or ArcGIS Online using GeoAnalytics Engine. ... View more

Hi Claire,  We are still investigating the behavior you're seeing, but as a workaround for now could you try the append mode with the truncate option set to True? This would be a good workaround if you don't have any schema changes in your layer. For example: featureServiceDf.write.format("feature-service")\      .option("gis", "myGIS")\      .mode("append")\      .option("serviceUrl", myURL)\      .option("layerId", 0)\      .option("truncate", True)\      .save() I'm hoping this will work as expected and not require running the same cell twice to update the layer. ... View more

Hello @minanasa_mn, thanks for your questions! Can you clarify what you mean when you say "I can not get the counts of points within polygons" - is the tool failing, or are you not getting the result that you would expect? The behavior you observed for polygons is expected, the population values are proportioned by the area of the polygon that intersects, so it is not a simple summation of the population of the 5 polygons. For a more detailed explanation check out this post that @DanPatterson  shared https://community.esri.com/t5/arcgis-pro-questions/arcgis-pro-summarize-within/td-p/364406 The GeoAnalytics Summarize Within tool is not a replacement of the Analysis Summarize Within tool, it is a separate tool with similar functionality that uses a distributed implementation ideal for handling larger datasets. The Analysis tool is available if you have a Basic, Standard, or Advanced license for ArcGIS Pro while the GeoAnalytics Desktop toolbox requires an Advanced license. See this overview of the GeoAnalytics Desktop toolbox for more details. Both the GeoAnalytics and Analysis Summarize Within tools should work with points, so please share any errors you're seeing and we can try to diagnose the issue. If you are only trying to summarize points into polygons, I would also recommend trying the Aggregate Points tool, which is focused on point feature summarization.  Best regards, Noah ... View more

Hi, from the logs you shared it looks like your GeoAnalytics Server is failing to write a feature service to the Spatiotemporal Big Data Store (different from a BDFS [Big Data File Share], which you can also write to). This can happen when the lines created by the Reconstruct Tracks tool are too large. One way to avoid this is by splitting your tracks into smaller segments using a time, distance, or attribute criteria when running Reconstruct Tracks. Can you please try using one of the four track splitting methods described here to break up your AIS tracks into smaller segments and see if the tool succeeds? ... View more

Hi @AFackler_NAPSG , the reason you are still seeing this error is that arcgis.geoanalytics is not supported by https://arcgis.com, it requires a base deployment of ArcGIS Enterprise and a licensed GeoAnalytics Server to run each function. There is an issue where arcgis.geoanalytics.is_supported() will incorrectly return True in the case above, we are working on fixing this.  If you don't have ArcGIS Enterprise and a GeoAnalytics Server you could instead try to create a Pandas DataFrame or Spatially Enabled DataFrame, add a column and calculate time using python's built-in time module, and export the DataFrame to a Feature Layer. You could alternatively add a field directly to the layer using this example and edit your features to populate the timestamp.  ... View more

sabarish balakrishnan‌, I am glad you were able to get your CSVs into a feature service layer. However, if you do not have a GeoAnalytics Server available to use, you won't be able to run the tool. You can check this using  arcgis.geoanalytics. is_supported() .  I would recommend using the standard feature analysis tool instead if you do not have a GeoAnalytics Server, which is in a different module in the ArcGIS API for Python. See  arcgis.features.find_locations. find_similar_locations  and Find Similar Locations—Portal for ArcGIS | Documentation for ArcGIS Enterprise  ... View more

Hi sabarish balakrishnan, please see the example here Find Similar Locations—Portal for ArcGIS | Documentation for ArcGIS Enterprise as well as the link Dan shared above.  If you are not working with a large dataset, you can also consider using the non-GeoAnalytics version of the tool:  arcgis.features.find_locations module — arcgis 1.8.2 documentation  ... View more

Hi Mallemala Kishore, can you please contact Technical Support about this case? They'll be best equipped to troubleshoot with you and figure out what's causing the error you mentioned.  Best regards, Noah Slocum - Product Engineer, GeoAnalytics Team ... View more

Hi Sorato Souza e Silva‌, can you verify that you don't have a definition query or extent set that would cause all of the input features to be filtered out? Otherwise it may be bug in the tool - can you try running the same job without a specifying a date for the Entity of Interest? For example: ... View more

Hi Mody,  Both GeoAnalytics and GeoEvent are not supported in AGOL, so you will need to install a base deployment of ArcGIS Enterprise to get started. For your remaining questions, I would recommend reading the documentation specific to deploying ArcGIS Enterprise on Azure, which can be found here: https://enterprise.arcgis.com/en/server/latest/cloud/azure/deploy-web-gis-on-azure.htm  1) This is explained in our documentation on adding a server to your base deployment (this applies to both GeoEvent and GeoAnalytics) 2) Please review this help on adding a spatiotemporal big data store.  3) You can install GeoEvent and the spatiotemporal big data store on one machine but we do not recommend this, as the two components will compete for resources and you will likely see performance problems as a result. It's best to install the spatiotemporal big data store and GeoEvent Server on separate machines. 4) See adding a server to your base deployment. This must be done with ArcGIS Enterprise and will not work with AGOL. 5) The spatiotemporal big data store should be registered with your hosting server, not your GeoAnalytics server. Please see this documentation on creating a data store. Hope this helps, Noah ... View more

Mody, I am glad to hear your deployment is coming along. You will be fine with 3 Spatiotemporal Big Data Store machines. Because the GeoAnalytics file server will not be doing any computation and will not be writing to the Spatiotemporal Big Data Store it does not need to be considered.  Best Regards, Noah  ... View more

Hi Zakaria Douiri‌, I'm happy to say that we've added support for connecting to an HDFS file configured with Kerberos authentication with ArcGIS Enterprise 10.6.1. The documentation here explains how to register a Big Data File Share of that type. Noah Slocum GeoAnalytics Product Engineer ... View more

Hi Mody, thanks for the questions! Here are some answers in addition to Joshua's post above: Yes, this is a valid configuration for getting started with GeoAnalytics. You should have one machine for your base ArcGIS Enterprise deployment and a matching number of GeoAnalytics and Spatiotemporal Big Data Store machines. Your GeoAnalytics machines should be deployed last. The recommended workflow is: Create a base deployment of ArcGIS Enterprise using ArcGIS Enterprise Cloud Builder for Microsoft Azure (see Deploy ArcGIS Enterprise on Microsoft Azure—ArcGIS Enterprise | ArcGIS Enterprise). Add Spatiotemporal Big Data Store machines to your base deployment (see Add a spatiotemporal big data store to ArcGIS Enterprise—ArcGIS Enterprise | ArcGIS Enterprise). Run Cloud Builder once again to create a GeoAnalytics Server site. You can provide the credentials of your base deployment under Federation Options and Cloud Builder will federate your GeoAnalytics Server site with the base deployment for you (see Add an ArcGIS Server site to your Enterprise deployment—ArcGIS Enterprise | ArcGIS Enterprise). What do we set in the number of machine? 3 machine? When deploying your GeoAnalytics Server site with Cloud Builder, you should un-check the Single machine deployment option and specify that you would like 3 machines in your site. then where is the portal? Do we need to add the other 3 temporal machine later - how do we create the 7 machine configuration Portal will be installed with the base deployment (see item 2.i above) and your Spatiotemporal Big Data Store machines should be added to the base deployment after it is configured (see item 2.ii above). Joshua is correct in that Pro is not installed with ArcGIS Enterprise. You should install Pro locally and then connect to your Enterprise from the application. Please see Manage portal connections from ArcGIS Pro—ArcGIS Pro | ArcGIS Desktop for more information.  Let me know if anything above does not make sense and I would be happy to explain more   ... View more