|
POST
|
didn't usse parallel processing settings up to now. thought if not set all ressources are going to be used.. no vpn no ondrive. just a superfast 2 years old machine. the option of runnng a 1500m select sounds pretty promising -- thx for the hint !!! will try that ! i would use EPSG 3035 since the data covers whole area of europe. but this one is equal area and at the outer areas of the extent of epsg 3035 i would have reasonable problems with distance values then so i stepped back to the geodetic-mode. since i know that postgis doesn't use spatial indices for ST_DISTANCE geodetic version, i thougth that coud be an issue in argis pro too ...
... View more
01-17-2025
05:56 AM
|
0
|
0
|
553
|
|
POST
|
i am about to generate a near table. the input is a metric CRS and the output distance unit is set to meters, the method is set to "Geodesic" - in order to get non-projected distances. the origins are about 6.7 mio points all over Europe, near features are about 30 mio polygons. everything is spatially indext - of course. and a search radius is set to a pretty low value of 1500m ... everything works fine, so far on sub-samples. but the performance is deeply disappointing with the 6.7mio points and definitely not up to any reasonable standard. especially when considering that the machine is a i9-13900K, 24 core, 128 GB RAM device. according to the windows ressourcemonitor.app exactly 3 % of the cpu performance are used to do my calculations. ... three percent ! are there any ideas for workarounds, multithread settings or anything like this to incerase performance ? best robert
... View more
01-15-2025
03:09 AM
|
0
|
2
|
610
|
|
POST
|
to my mind all of this is not really a "solution". int32 provides the capacity of about 12 bilion oids - so in next to all cases that should be sufficient. and if a dataset comes with int64 oid there should be a straight forward approach out of the box - i.e. a simple arcgis pro function.
... View more
11-18-2024
06:07 AM
|
1
|
1
|
3752
|
|
POST
|
@GBacon: i would have expected a more impressive advantage by using a GPU. 72 compared to 50 hours obviously is less than 50% increase in performance. so even without using the gpu this increase should be much higher by using up to 32 cores on modern machines compared to just one core with the previous version.
... View more
03-21-2024
06:56 AM
|
0
|
1
|
911
|
|
POST
|
according to my personal experience there is one aspect of that behaviour that might have changed ... i believe. one of the issues when working with "join" or "join field" (which i prefer) is that rerunning just parts of the model my result in multi-joins of the same field. i frequently use a select just in front of the "join field" to avoid that ... and i have experienced that the rerun of nodes that are subsequent to that select trigger reruns that reach back to that point. this might be implemented intentionally to avoid multi-joins. this does'nt mean that i am happy with that behaviour but it could be intention. but there still are model resets of model-parts that seem to be triggered randomly ! ! !
... View more
01-30-2024
12:12 AM
|
0
|
1
|
1633
|
|
POST
|
i have a pretty complex street network from a whole European country. the data is detailed concerning geometrical accuracy as well as categorial diversity. it spans street categories from hiking trails to motorways. and according to the hierarchical organizational structure, different approaches to coding categories are found in different parts of my data. what i want is to do multimodal routing on top of a single network and identify those edges that can be used by a specific traffic mode via restriction-settings on the network side and search criteria/snap settings on the Stops-side. my problem is, that there are misassignments of street categories that result in isolated subnets. i.e. for instance a certain area where cars are allowed to drive which is connected to the rest of the network via edges that are reserved for pedestrians. running the routing results in locations that are allocated to that part of the network and returns an error since the routing can't reach the destination whenever it is located outside of the isolated subnet part. these and similar situations do occur in serious magnitudes within a dataset of 2 mio edges. up to now, i didn't find a tool that can do a topological analysis and identify every disconnected part of my network. i have been reading some information about utility-networks (where that kind of "find disconnected" tool exists) but an approach where I have to set up a fake utility-network out of my street data seems to be too complex to me. any ideas ? thx in advance
... View more
01-11-2024
01:50 PM
|
0
|
0
|
773
|
|
POST
|
@GBacon ... well actually i am not really impressed by an overall 16% utilization-indicator. would be interesting, what the processing-time benefits are. have you tested without parallel processing ?
... View more
12-19-2023
08:18 AM
|
0
|
1
|
2754
|
|
POST
|
@JohnBrand similar problem here - and i didn't get the point of your last message. i have a script that chanes Null-Values in a table into zeros and i have put that script into a script-tool-node. since the script doesn't return any output i am not able to use the node as a precondition for the following "calculate field" node. adding a parameter with the default path - as you supposed - doesn't change my situation - since this input parameter can't be used as a precondition for the field calculator node as well. so i think i would need a return value within the script, use that value as an (output-)parameter, use that parameter as a variable within my model, and somehow check that variable value as a condition for going into the calculation step of my "Calculate Field"-node. but i have no idea how to implement that ... thx for help
... View more
08-07-2023
03:55 AM
|
0
|
0
|
4452
|
|
POST
|
hi again, unfortunately, i was not able to reproduce the problem on top of a new model and thus i can't provide a simple demo. but what i have is a video-sequence that shows the reset. i just added a "caluclate field" object and connectet that object with the output of a simple select that was already calculated. and i don't have any idea why and when that problem emerges. some experiments based on a clone of that configuration of select and calculate field didn't come up with the same behaviour ... sorry, but i can't provide that specific project due to it's size and copyright issues. but i will continue to search for a more simple porject in my archives. best robert
... View more
04-11-2023
09:06 AM
|
0
|
0
|
1930
|
|
POST
|
hi shitijmehta, if you'd need more than one. no problem, because every single model is affected by that problem. if required or helpful i would provide a simple demo as well.
... View more
03-31-2023
03:12 AM
|
0
|
2
|
1939
|
|
POST
|
thx, of course i have been reading the whole documentation in advance. and i have been experimenting with even smaller (than 4000 x 4000 cells) rasters. especially with the environment parameters for parallel processing - without any significant effect on the performance. and still the first issue is the overall performance of intel's flagship processor but the second is even more concerning - the less advanced machine is on par - both with about 7% workload. which means with more or less just one core working on the calculation job. that concept seems to be pretty outdated to me ... but i am still searching for workarounds and settings to bypass these limitations
... View more
03-05-2023
11:52 PM
|
1
|
0
|
3626
|
|
POST
|
i am working on a intel core i9-13900k machine with 24 cores, 128gb ram and one of the fastests nvme ssds currently existing. and i am about to do some experiments with a test region of about 4000 x 4500 cells 10x10m each. the expected reuslult set to "Whole year", all the other settings are left default exept for the "Diffusse proportion" - changed from 0.3 to 0.32 and "Transmittivity" from 0.5 to 0.48. that calculation takes quite a long time and the most annoying thing is, that the taskmanager shows just one single core doing at least something - at an overall cpu workload of 7 - 9% and a rate of about 1,5 to 5.2 GHz. but on top of that astonishingly poor performance one older machine with lower performance specs in any dimension is outperforming the modern machine by about 30% (!).
... View more
03-05-2023
10:51 AM
|
3
|
15
|
4744
|
|
POST
|
actually i would say, „it“ happens each time with any of my models at some point. and i am really surprised that the support department is not aware of the issue up to now - since it started with the very first version of arcgis pro 3.x ! … so i will try to find time to send one of the more simple models that are affected. … since the whole thing is not only annoying but undermines the concept of working with models.
... View more
03-05-2023
02:23 AM
|
0
|
0
|
1986
|
|
POST
|
unfortunately, the reset to "ready-to-run" error still exists in the current patch - which is pretty annoying if you run models where some nodes take hours to calculate !!!
... View more
03-02-2023
10:41 PM
|
0
|
0
|
1995
|
| Title | Kudos | Posted |
|---|---|---|
| 1 | 11-18-2024 06:07 AM | |
| 1 | 06-07-2021 06:42 AM | |
| 1 | 03-05-2023 11:52 PM | |
| 3 | 03-05-2023 10:51 AM | |
| 5 | 01-16-2018 10:02 AM |
| Online Status |
Offline
|
| Date Last Visited |
10-22-2025
02:12 AM
|