|
POST
|
Hi, I have used multiprocessing in the past to perform some intensive geoprocessing and was able to speed up by using all cores . It worked quite well. These were all script tools that were used in Desktop. However, I had a question if multiprocessing can be used in a geoprocessing service and would that actually be sensible. I am looking at a script that performs a series of geoprocessing steps over separate point locations and the problem is embarrassingly parallel. It takes between 3 to 4 minutes per location for processing. However, it also needs to be available as a gp service. So lets say, a user submits a job and the server is using up all cores to process that job. Does it mean that if another user submits a job, he has to wait till the previous job completes and frees up the cores? This would mean the second user will have to wait for a long time to get results back. I could set it up to use only half the cores, does that mean it will now support two concurrent users? The third one has to wait till one of the previous two completes and frees up some cores. If you dont use multiprocessing, does it mean that you will be able to support more concurrent users, but the completion of each job will take a very long time since the geoprocessing steps are run in series. It would be great to hear some thoughts and experiences on this from you guys! Any other options to improve performance and scale, other than adding servers to the cluster? Thanks.
... View more
11-28-2017
04:55 AM
|
0
|
0
|
1001
|
|
POST
|
No Dan, we cannot delete that field as it is part of an intermediate feature class/table that gets generated during the solve process. It is saved in the geodatabase as "TempInput" only because the process crashed out. During normal runs, it gets created and deleted automatically. Only this time, since the process crashed, we see the TempInput featureclass remain in the output gdb.
... View more
07-31-2017
12:36 AM
|
0
|
3
|
3219
|
|
POST
|
I am unable to solve a closest facility problem in ArcGIS Desktop 10.2.2 with ArcPy using the sample code provided in help documentation. I get this error: ERROR: A geoprocessing error occurred. ERROR 001156: Failed on input OID 32768, could not write value '32768' to output field ORIG_FID Failed to execute (FeatureClassToFeatureClass). An error occured on line 27 A geoprocessing error occurred. ERROR 001156: Failed on input OID 32768, could not write value '32768' to output field ORIG_FID Failed to execute (FeatureClassToFeatureClass). Failed to execute (FindClosestFacilities). It seems to me this is a bug with field mapping that is occurring internally. Its obvious that ORIG_FID should be a long int and it actually is short int. That is why we are seeing this exception at 32768. I am using the San Francisco network dataset available in ArcGIS tutorial data, with some randomly generated facilities (about 100,000) over the area. This is the code that throws the error. import arcpy
from arcpy import env
try:
# Check out the Network Analyst extension license
arcpy.CheckOutExtension("Network")
# Set environment settings
env.workspace = r'C:\arcgis\ArcTutor\Network Analyst\Tutorial\SanFrancisco.gdb'
env.overwriteOutput = True
# Set local variables
inNetworkDataset = r'C:\arcgis\ArcTutor\Network Analyst\Tutorial\SanFrancisco.gdb\Transportation\Streets_ND'
inIncidents = r'D:\Sample data\sampledata.gdb\incident'
inFacilities = r'D:\Sample data\sampledata.gdb\manholes_sf'
outGeodatabase = r'D:\Sample data\sampledata.gdb'
#outGeodatabase = "in_memory"
outRoutes = "Routes"
outDirections = "Directions"
outClosestFacilities = "ClosestFacilities"
measurement_units = "Meters"
# Run FindClosestFacilities. Choose to find only the closest facility.
arcpy.na.FindClosestFacilities(inIncidents, inFacilities, measurement_units,
inNetworkDataset, outGeodatabase, outRoutes,
outDirections, outClosestFacilities,
Number_of_Facilities_to_Find=1)
print "Script completed successfully"
except Exception as e:
# If an error occurred, print line number and error message
import traceback, sys
tb = sys.exc_info()[2]
print "An error occured on line %i" % tb.tb_lineno
print str(e)
... View more
07-27-2017
03:42 AM
|
0
|
7
|
3628
|
|
POST
|
Kelly, thanks for your response. I was just trying to assess if this behavior is already a known issue from the community before we contact tech support. Other community members facing a similar issue may also benefit from this before they go through the support process. We are building an appbuilder widget and do not wish to include a dependency on a geoprocessing service which complicates the deployment. So the extract data task is not an option for us.
... View more
12-20-2016
11:09 PM
|
0
|
0
|
3660
|
|
POST
|
Hi, We are seeing issues with create replica in shape format. We are trying to get features within a polygon as shapefile. It does not work when a polygon geometry is supplied while creating the replica. It returns a zip file containing the shapefile, but the shapefile always has zero features. We have confirmed that the polygon contains features from the layer, but it always returns 0 features in the zipfile. It works well when filegdb is set as the output format and we are able to see only features within the polygon. If we do not provide the polygon geometry, then it works and downloads the complete dataset as shapefile. But we are looking for downloading only within specified polygon geometries.
... View more
12-20-2016
03:56 AM
|
0
|
2
|
3660
|
|
POST
|
Consider this ImageService which is a Land cover raster layer with many classes e.g, forest, water, shrubland. I am trying to use the new RasterLayer API to find which pixels are within the buffer geometry and summarize the areas of forest, water, shrubland within the buffer geometry. Is this possible? I can see the pixelData, but how does one find which pixel lies within the buffer geometry? and then compute the areas for each class within the buffer geometry. I did see a similar example being demonstrated in one of the videos at video.arcgis.com (pl see screenshot). Not sure how they did that, any clues?
... View more
08-19-2016
04:06 AM
|
0
|
0
|
1222
|
|
POST
|
Hi Nils, Sorry to wake a three year old thread. I was having the same question and your response prompted me to look further. It seems you "cannot" use app logins for spatial analysis services. Please have a look at the capabilities table in this link ArcGIS Security and Authentication | ArcGIS for Developers under app logins. It clearly states app logins cannot be used with spatial analysis services.
... View more
07-06-2016
03:18 AM
|
0
|
0
|
1888
|
|
POST
|
Hi FC Basson, I actually have a python script tool with about 25 input parameters. I run this tool and while publishing as gp service, I select about 20 parameters to be constants, i.e., stuff like path to data etc., which does not need to exposed as a parameter in the rest end point. Only the parameters that need to be exposed at the REST endpoint are set as "User defined". I do this in desktop. When scripting this publishing process, i run the tool through python, create the sddraft, then the sd(service definition), then stage and upload to server. In this process, i could not find a way to configure parameters as "Constant" or "Userdefined". Is this making sense now?
... View more
05-24-2016
04:26 AM
|
0
|
2
|
1629
|
|
POST
|
When scripting the publishing of geoprocessing services using python, how can we set certain tool parameters to be of "Constant value" type or "User Defined" type? Can we do this only in the service editor in Desktop while publishing? How can we do this via scripting?
... View more
05-24-2016
02:18 AM
|
0
|
4
|
3690
|
|
POST
|
I was looking at Pro documentation and stumbled on this. It clearly says that you can create features interactively in "ArcMap" in Pro documentation, but there is no mention of it that you cannot do this in Pro. http://pro.arcgis.com/en/pro-app/arcpy/geoprocessing_and_python/setting-script-tool-parameters .htm Does this mean its not supported in Pro?
... View more
05-12-2016
04:44 AM
|
0
|
4
|
2367
|
|
POST
|
Hi, I have a toolbox(.tbx) containing a python script tool which has a featureset as one of the inputs. I have set the schema for this featureset in Desktop and I am able to interactively create features on the map while running the script tool. How do I do this in ArcGIS Pro? When I open the same script tool in ArcGIS Pro, it does not show me the option to create features interactively. It asks me to browse to a layer!
... View more
05-11-2016
09:20 AM
|
0
|
6
|
3927
|
|
POST
|
Hi, I see that you can display a layer and field selector in the configuration panel. I was wondering how can you display tables that are added to the webmap as a list that users can choose from? If you look at the graphic below, it has an example of supportedTypes: FeatureLayer, in LayerOptions I got this snap from Add configurable parameters to templates—ArcGIS Online Help | ArcGIS What's the key to use a table? What are the other supported types? Is there a list of supportedTypes values available somewhere? regards Anand
... View more
03-23-2016
03:19 AM
|
0
|
0
|
2181
|
|
POST
|
We have a polygon feature layer that is related to another point feature layer through a relationship class (1 to 1) defined at the geodatabase level. When a relationship query (query related records) is executed at the rest end point of the polygon feature layer, I would expect the result to be a point feature. This works fine when the feature layers are hosted on ArcGIS Server. However, when the feature layers are hosted on ArcGIS Online, I get a polygon result! The same service definition file is used to publish the service on ArcGIS Server as well as ArcGIS Online, so the data structure is exactly the same. Here are the relationship queries that you can execute and have a look at the results. ArcGIS Server - Query - https://csslesxi16-vm17.cybertech.com/arcgis/rest/services/Hosted/DC_pollingplaces_with_attachments/FeatureServer/1/quer… Result - The relatedRecordGroups in output contains the correct point feature as expected. Now observe that the layer definition returned in the result is of type esriGeometryPoint. The fields reported in the layer definition are also of the point layer. ArcGIS Online Query - http://services1.arcgis.com/DlnuvLGpDczjeSgG/arcgis/rest/services/DC_pollingplaces_with_attachments/FeatureServer/1/quer… Result - The relatedRecordGroups in output contains the correct point feature as expected. However, observe that the layer definition returned in the result is of type esriGeometryPolygon and the fields reported in the layer definition are of the point layer! Looks like a bug in ArcGIS Online hosted feature services? or am i missing something? I have also attached the service definition file if you'd want to quickly reproduce.
... View more
08-04-2015
05:54 AM
|
0
|
1
|
3515
|
|
POST
|
ArcGIS DataStore schedules regular backups of its database every 7 days by default and retains them for 31 days. Due to this, the disk space is getting filled up over a period of time. I am also seeing that most of the disk space is occupied at "C:\arcgisdatastore\backup\walarchive". I am thinking these are postgres db archive files as the name suggests. Is it ok to clean up this directory completely from time to time? Will this affect the ability to restore backups?
... View more
07-27-2015
05:47 AM
|
3
|
14
|
16097
|
| Title | Kudos | Posted |
|---|---|---|
| 1 | 07-16-2021 03:26 AM | |
| 2 | 04-10-2023 07:18 AM | |
| 5 | 04-10-2023 07:08 AM | |
| 1 | 04-08-2022 06:00 AM | |
| 1 | 04-26-2021 04:00 AM |
| Online Status |
Offline
|
| Date Last Visited |
09-29-2023
12:31 PM
|