|
POST
|
Hi Carsten Hogertz, To try and reproduce the issue, I'll need to follow the exact steps you took. Can you please explain what you did to "set up the ESPG the correct way now". Can you also let me know how you ran the tool through Pro. For example: 1. Added the hosted layer from the content pane to the map. 2. Ran Aggregate points with the following parameters {list parameters}, and selected the input layer by {browsing to the layer, typing it in, using the drop down, other?} 3. Copy the logs from the tool run. Thanks, Sarah
... View more
04-06-2018
09:21 AM
|
0
|
0
|
1880
|
|
POST
|
Hi Carsten Hogertz, Given your other question - I have a few questions for you on how you are running the tool: Copy to Data Store - GeoAnalytics. 1. Are you running this tool through ArcGIS Pro? 2. We expect a hosted layer to run faster than a layer in an EGDB. For a hosted layer, the data is read directly from the database. With an EGDB, we read the data over REST. 3. How are you setting the spatial reference for running the job? Do you mean you are creating a new dataset, or are you setting it the output spatial reference (Pro) or the processing spatial reference (Portal, REST), or other? Thanks, Sarah
... View more
04-05-2018
01:43 PM
|
0
|
2
|
1880
|
|
POST
|
Hi Carsten Hogertz, Jonathan Quinn is right - this is usually something token related. We sometimes see this when you switch your active portal within the Pro session. Can you make sure you have set your portal with GeoAnalytics as your active portal and are signed in. Can you then restart Pro and try running a GeoAnalytics tool again? If that doesn't work, can you go Map Viewer in portal and make sure you're able to run a GeoAnalytics tool there? If you can't, you might not have the correct permissions. Thanks, Sarah GeoAnalytics Product Engineer
... View more
04-04-2018
09:21 AM
|
0
|
4
|
1736
|
|
POST
|
Hi Joshua, We currently document in all GeoAnalytics tools in Pro this limitation. We have iterated on a few different solutions to warn users not to do this, but haven’t come across a “best” solution that we want to ship in released software yet. I’m hoping this isn’t too hidden: It is recommended to use feature layers hosted on your ArcGIS Enterprise portal or use a big data file share data when running GeoAnalytics Tools through ArcGIS Pro. Other data sources may perform slowly when there are more than 1000 features. We do find that most users of very large data are using either data from: A collection of delimited files, in which case big data file shares are the solution Data ingested from GeoEvent server. In which case, the data is exposed as a layer in their portal. So far, from what we've seen and heard from user feedback is that having lots of very large datasets in file geodatabases isn’t that common – although it’s obviously something that you have!. I’ll work with the team to figure out and assess this use case. Sarah Ambrose Product Engineer, GeoAnalytics Server
... View more
03-28-2018
03:28 PM
|
0
|
1
|
2267
|
|
POST
|
Hi Dalinda, One of the big advantages of big data file shares is that multiple datasets can be represented as a single dataset. For example I could have a csv for lightning strikes in January, a separate csv for February, and another for March. If I put them all in the same folder (let’s call it “lightningStrikes”), and they have a matching schema, GeoAnalytics analyzes those three datasets as a single “lightningStrikes” dataset. This is a pattern that we’ve followed from the “big data” world. The same applies for shps, so they 2GB limit isn’t that limiting here. Thanks, Sarah
... View more
03-28-2018
03:22 PM
|
0
|
3
|
2267
|
|
POST
|
Hi Dalinda, I have two recommendations, and they depend on the size of the data. Option 1 is good if you are using Pro, the portal Map Viewer, the ArcGIS REST API, or the ArcGIS API for Python.Option 2 is only available to you if you are using ArcGIS Pro to run analysis. Share it as a feature service first - and in most cases I would recommend this! You can do this through Pro (creating a hosted or non-hosted layer) using the Sharing pane. You can do this in Portal, by uploading a zipped file gdb + publishing a hosted layer through Portal. Once you have a feature service, you can analyze it! If the data in the file geodatabase is pretty small you could add it to the map in Pro, and just run analysis on it. Only do this if the dataset is small (< a few hundred features). A good example of this would be if you were joining a big dataset to a small dataset, or aggregating a lot of data into a small polygon dataset. For both of these examples, the file geodatabase is the "small" dataset! If this is a feature you’re interested in, I would recommend adding an enhancement request through Esri support services. I’ve made a note of it, but with an official enhancement request, we’re able to see when multiple users want the same functionality, and prioritize the most popular ones first. A note on this comment: By default, GeoAnalytics results are stored in the spatiotemporal big data store. At 10.5.1 or later in the portal Map Viewer, and in Pro 2.0 and later, you can optionally save your results in the relational data store as well. Thanks for the question and let me know if I missed anything. Sarah Ambrose GeoAnalytics Product Engineer
... View more
03-23-2018
04:45 PM
|
2
|
3
|
2267
|
|
POST
|
Hi Carsten_Nexiga I usually recommend to move the data around as little as possible - especially with big data. For your case, I would guess it’s going to be faster to run the data directly from the big data file share than to publish the data, and then run the tool. But there may be other factors, for example if your csv is on a shared location that has slow network speeds, and it takes a while for the server to access it. Ultimately, I think there is more flexibility with a big data file share (such as being able to easily modify the data, more flexibility in time and geometry formats, ability to add multiple csvs to represent 1 dataset) that using a big data file share is usually more advantageous. For this response I assumed "effective" meant, “Which is faster?”. Let me know if that’s not what you mean and I’ll change up my answer a bit. Thanks, Sarah Ambrose Product Engineer, GeoAnalytics Server
... View more
03-08-2018
09:26 AM
|
1
|
4
|
1880
|
|
POST
|
Hi Carsten, There shouldn’t be a difference in performance at all. When you run a GeoAnalytics tool through the portal ma viewer and Pro it’s executing the analysis on the GeoAnalytics Server. The time to pass the information from Pro to the GeoAnalytics Server and the Portal Map Viewer to the GeoAnalytics Server should be very similar. There are other reasons to choose one experience over another, but it’s mostly based on personal choice. For example, there are more verbose messages in Pro on the status of the job, while the Portal experience is more simplified. Thanks, Sarah Ambrose Product Engineer, GeoAnalytics Server
... View more
03-08-2018
09:17 AM
|
0
|
0
|
642
|
|
POST
|
Hi Dalinda, The way I conceptually think about append is “I have an existing feature service that I am appending to, and I won’t be modifying the original schema. I can mix and match how fields are appended, but the original fields will remain”. It’s one existing dataset, and you are adding a new dataset to that existing one. Merge is more like taking two new datasets, and create 1 “new” one from those. With the append operation, the data that's already "there" stays, and we can only modify what’s being added. I think its best explained with an example though: Say I have a feature service layer with fields named [Field1, Field2, Field3] and I want to append a dataset with fields named [Field1, Field2, Field4, Field5]. There is nothing I can do so that the appended dataset will have 4 fields, because the original schema will remain. I can do some mixing and matching if I want in the field mapping (say, Field4 is appended to Field 3), but the schema of the data, once everything has been appended will always have 3 fields, named Field1, Field2, Field3. Does that make sense? Is that the functionality you are looking for, or would a merge be more suitable? This is similar to how ArcGIS Pro append works. “Because the input datasets' data is written into an existing target dataset that has a predefined schema (field definitions), the Field Map control does not allow for fields to be added or removed from the target dataset.” Thanks, Sarah
... View more
03-06-2018
10:29 AM
|
1
|
1
|
1760
|
|
POST
|
Hi Dalinda, Intersect and Union are exactly what I’m talking about for Overlay Layers! Those are being worked on now. We haven’t had any other requests for Repair Geometry, but we’ve noted it down. If you would like to email me a few more details about your use case, that would help us in prioritizing this tool (sambrose at esri.com). If you could also send me some details in what you are interested in dissolving (just generally something like “I want to dissolve overlapping polygons”, that would help as well). We don’t currently have a standalone tool for projecting data, but you are able to set a processing spatial reference through Pro and Portal. This will project the data on the fly, and if it’s saved to the relational data store, maintain that projection. As for Merge, we’re currently working on a way to Append Data, which would give similar functionality. The only difference would be that you can’t modify the original input data. If you don’t think Append will meet your needs, please let me know what would be missing from it. We don’t currently have a way to clip data to a specified polygon. You can specify an analysis extent, but it won’t change polygon boundaries, only isolate and use the intersecting features in analysis. We’ll be sure to post in the Big Data place if the GeoAnalytics videos become available. I really do recommend the conferences if you get the opportunity! Product teams are there in person to talk and discuss with ArcGIS users. A win for users, and a big win for us to hear what you’re looking for in the product! Let me know if I missed anything, Sarah Product Engineer, GeoAnalytics Team
... View more
03-03-2018
02:17 PM
|
1
|
1
|
1760
|
|
POST
|
Hi Dalinda, Another great question! We aren’t able to tell how much of our users are mixing traditional desktop tools with GeoAnalytics tools. But, I can give you some general best practice guidelines and recommendations of when to use a mix of regular Pro GP tools and GeoAnalytics tools. When we run GeoAnalytics tools with regular desktop tools (talking about Pro specifically here) we mostly do it in the following scenarios: When we start using GeoAnalytics and use it to summarize, aggregate or analyze the data so that it becomes a more manageable size. Then we chain Pro tools on using the smaller, more manageable result. When we’re analyzing data that’s of a size we could analyze with Pro tools, but we’re hoping to take advantage of capabilities only available in GeoAnalytics (like time steps in Aggregate Points, tools unique to GeoAnalytics, accessing data in a big data file share). Let me know if you have any more questions on a specific use case or workflow. With more details on the type of data, data location and planned analysis, I can help figure out the best place to stage your data, and recommend how to take the most advantage of analysis on ArcGIS Enterprise. Sarah Ambrose Product Engineer, GeoAnalytics Team
... View more
03-02-2018
05:33 PM
|
1
|
1
|
957
|
|
POST
|
Hi Dalinda Damm, Great question! GeoAnalytics definitely works for space only. We often emphasis time in presentations and documentation because it’s a new concept for analyzing GIS data. Most customers of GeoAnalytics have time enabled data, since big data is often observational data accumulated over time, but many don’t use time at all! There are only 2 tools at 10.5/10.5.1 that require time, Create Space Time Cube and Reconstruct Tracks. At 10.6, the tool Detect Incidents requires time. Other than those listed tools, you can take advantage of lots of ‘run of the mill’ tools that have been implemented for distributed analysis. For example, some of our most popular tools that don’t require time are Aggregate Points, Join Features, Summarize Attributes, Find Hot Spots and Copy to Data Store. Please let me know if you have any follow up questions. Thanks, Sarah Ambrose Product Engineer, GeoAnalytics Team
... View more
03-02-2018
01:11 PM
|
1
|
1
|
911
|
|
POST
|
Hi DalindaDamm, It is expected that there will be new tools exposed in the GeoAnalytics Toolbox in ArcGIS Pro at each release (and we’re working on more now!). It’s important to point out that Pro is a client for GeoAnalytics Server. This means that tools are first implemented in GeoAnalytics Server, and Pro is just one way of running the tools you have on your GeoAnalytics Server (you can run them through the Portal Map Viewer, the ArcGIS API for Python and REST as well). At 10.5 and 10.5.1 there are 12 GeoAnalytics Tools. At 10.6 we introduced three new tools, Calculate Field, Detect Incidents, and Geocode Locations from Tables. The Pro 2.1 release went out around the same time as 10.6, and exposed the Calculate Field and Detect Incidents tool. We’re currently working on 10.6.1 which will include some new tools. It is planned that these new 10.6.1 tools will be exposed in Pro 2.2. We’ll be continuing this pattern in future releases. Please note, if you have GeoAnalytics Server version 10.5 and Pro 2.2, you can only use the tools from 10.5, not the tools that were created at 10.6 even though your Pro version is recent. The focus of the new tools can be broadly categorized into a few groups: Classic GIS tasks (similar to join features, this could be something like appending data or applying overlays, as well as more track analysis to tie in with real-time data) More sophisticated analysis – we’re currently researching and working on machine learning and statistical techniques that are relevant to big data. Are there any tools or workflows you were hoping to use GeoAnalytics for? Please let me know if that doesn’t answer your question. Let me know if you’ll be at the upcoming DevSummit, User Conference, of Federal User Conference and I can recommend some sessions to attend related to GeoAnalytics. Sarah Ambrose Product Engineer, GeoAnalytics
... View more
03-02-2018
12:09 PM
|
1
|
3
|
1760
|
|
POST
|
Hi Chen Chen Thanks for your question. I have a few questions and suggestions to get you started: When you say you are trying to start GeoAnalytics Tools, how are you trying to start them? The correct way is to enable them through your portal > Organization > Edit Settings > Servers > Feature Analysis – GeoAnalytics Tools. If you aren’t setting them that way, can you please try that? (Step 8 here) If that doesn’t work, can you try stopping your ArcGIS Server service (on all machines with a GeoAnalytics Server)? In Windows 10 go to the Windows start menu > type services > Open the services desktop app > Select ArcGIS Server > Restart. After a few minutes try and set the GeoAnalytics server again. If both of these steps don’t work, can you please contact technical support? They will be able to assist you in troubleshooting the cause of this issue. Please let me know if that helped, or if you are seeing a new error. Sarah Ambrose GeoAnalytics Product Engineer
... View more
02-05-2018
08:44 AM
|
0
|
2
|
1514
|
|
POST
|
Thanks for your response. If you are able to provide an example of documentation that you are expecting, I can try and prioritize writing it for the next release. In the meantime, if you’d like to send me an email at `sambrose at esri.com` with your case number, I can help look into this issue. Happy new year! Sarah
... View more
12-29-2017
06:08 AM
|
0
|
0
|
2449
|
| Title | Kudos | Posted |
|---|---|---|
| 1 | 07-18-2023 04:44 AM | |
| 1 | 06-01-2021 07:01 AM | |
| 1 | 07-29-2020 03:36 PM | |
| 1 | 04-13-2015 10:32 AM | |
| 2 | 05-29-2018 01:19 PM |
| Online Status |
Offline
|
| Date Last Visited |
11-21-2025
09:23 AM
|