topic Re: Arcgis very slow in Geoprocessing Questions

Arcgis very slow

joycemaia — Thu, 21 May 2015 03:20:42 GMT

Hello!

Does anyone know how I can speed up the process Join Space ?. On my machine it has taken too long.

This is my setup

i5 3.0 GHz

8GB RAM

thanks

Re: Arcgis very slow

DanPatterson_Retired — Thu, 21 May 2015 03:24:32 GMT

We need details. Featureclasses? shapefiles? files on local disk? on network? are the files indexed? size?

or use small, indexed featureclasses stored on a local disk

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 03:49:21 GMT

The files are quite large, but I have done it before and had not taken so long.

I formatted the computer and now I'm with Win8

All files are on the PC, look at the printscreen of an example of all my files.

The idea is to cross points to polygons

Another issue is very different save files in a specific folder to save the directory: C: \ Users \ Joyce \ Documents \ ArcGIS \ Default1.gdb

Re: Arcgis very slow

DanPatterson_Retired — Thu, 21 May 2015 04:09:50 GMT

See Curtis's comments in this thread regarding *.mxd's

Performance problems in desktop 10.3.1?

So 2 things. First, save to a simpler drive path...you should only use that c:\user\thingy folder for photos and junk

Create/use a simpler folder ie c:\gis\file
copy both files there
start a new project and add both files either as shapefiles or send them to a new geodatabase
make sure that they are in the SAME coordinate system...looking like they are isn't good enough...Use the Project tool to get them into the same projected coordinate system
index the Shape field for both files
try again

good luck

Re: Arcgis very slow

curtvprice — Thu, 21 May 2015 04:10:59 GMT

You have a shapefile there that has a dbf approaching the 2GB limit. This is an operating system limit!

You may want to consider putting these feature classes in a file geodatabase. They are pretty big but at least your processing is more likely work at all.

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 04:20:26 GMT

Thanks for the tips, will launch a new project this way to see if it helps.

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 04:21:34 GMT

The file is too large. I have over 4 million points to join with many polygons.

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 04:24:22 GMT

Do you think that kind of projection could influence this type of analysis (join space)?

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 04:34:41 GMT

The shapes of the polygons were reprojected to Albers. The shape with the points I make from my data, first I do it in WGS after reprojected to Albers

These are the files of properties

The Datum makes sense with the projection?

Data Type:	Shapefile Feature Class
Shapefile:	C:\a\south0.shp
Geometry Type:	Polygon
Coordinates have Z values:	No
Coordinates have measures:	No

Projected Coordinate System:	South_America_Albers_Equal_Area_Conic
Projection:	Albers
False_Easting:	0,00000000
False_Northing:	0,00000000
Central_Meridian:	-60,00000000
Standard_Parallel_1:	-5,00000000
Standard_Parallel_2:	-42,00000000
Latitude_Of_Origin:	-32,00000000
Linear Unit:	Meter

Geographic Coordinate System:	GCS_South_American_1969
Datum:	D_South_American_1969
Prime Meridian:	Greenwich
Angular Unit:	Degree

Re: Arcgis very slow

SepheFox — Thu, 21 May 2015 05:29:22 GMT

Are you talking about a Spatial Join, Joyce? The projection you use shouldn't slow things down, but as Dan says you do want everything in the same projection. Can you make a file geodatabase in ArcCatalog (right click in your folder, select new-->file geodatabase), then export all your shapefiles into the geodatabase (In ArcCatalog right click one of them, select export-->to geodatabase (multiple), and then add all your shapefiles into the dialog).

Re: Arcgis very slow

JayantaPoddar — Thu, 21 May 2015 08:38:39 GMT

Also turn off background processing.

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 16:27:06 GMT

I followed the tip of all the comments.

1º

I created a geodabase with data

Added 4 shapes of polygons (countries, states, cities and districts of South America)

1 and the shape points (observation species)

2º

Join realized the Space as follows:

Analysis Tool-> overlay-> space join-> one to many

I think there is a difference in saving the job in the default output <inside geodatabase>,> takes longer to save in another way <another folder>

I realized that saving in another output <inside another folder> is faster. Only for some reason the ArcGIS is giving an error. This NEVER happened

He makes the table, but fails to display the map

As for time, it is almost the same thing! Tthe process is running forever.

Thus I modified the way cross data

Add the two shapes (polygons and points) on the desktop: right click (on top of the points layer) -> join and Relates

These methods are equivalent?

Thank you again!

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 16:35:56 GMT

The open when Arcgis uses only 30% of the processor, I changed the process for priority in real time. This did not show much difference.

As for RAM, ArcGIS uses very little. Google Chrome uses a lot more.

Do you think it would be very bad open the ArcGIS three times to run different tasks? So I speed work.

thank you!

Re: Arcgis very slow

SepheFox — Thu, 21 May 2015 16:39:13 GMT

Joyce, your geodatabase should be close to the root of your C drive, for example: C:\GIS_folder\test.gdb, and of course your shapefiles should all have the same projection.

Spatial Join joins the data by the location--one feature overlaps a feature in the other class, for instance.

Joins/relates joins data by a common field, such as a name or ID that is the same in each class.

So, they are not really the same--it depends what relates your two tables. If they are not related by location, then you should definitely use join/relate.

You are working with huge tables, as you said, so a spatial join will take a while.

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 16:53:53 GMT

See this is the file I'm working on:

https://www.dropbox.com/sh/b5bi24m8qjlyc5t/AAB-LY57CgAj0slEvljUzNk7a?dl=0

This file is in this directory: C: \ arc

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 16:57:43 GMT

I followed this tutorial:GIS Tutorial: How to perform a spatial join in ArcMap - YouTube

Re: Arcgis very slow

DanPatterson_Retired — Thu, 21 May 2015 17:12:58 GMT

It may just take a long time trying to do all the data at once. Partitioning the inputs into smaller subsamples may speed things up since the sum of the parts may take less time than the whole

Re: Arcgis very slow

joycemaia — Thu, 21 May 2015 17:20:49 GMT

I'm doing this to know what kinds of points (bird species) have in each polygon (geopolitical regions). Then I will eliminate georeferenced data and remove the duplicates. I need such a table:

Country	Sp	Area	Perimeter
Canada	sp1	x	a
Canada	sp2	x	a
Canada	sp6	x	a
Canada	sp9	x	a
United States	sp9	y	b
United States	sp212	y	b
United States	sp63	y	b
United States	sp9	y	b
Argentina	sp1	z	c
Argentina	sp2	z	c
Argentina	sp6	z	c
Argentina	sp9	z	c
India	sp1	w	d
India	sp243	w	d
India	sp6	w	d
India	sp9	w	d
India	sp154	w	d
India	sp76	w	d
India	sp6	w	d

Re: Arcgis very slow

SepheFox — Thu, 21 May 2015 17:43:00 GMT

Hey Joyce, I tried running the spatial join, and it is taking a long time. I think you'll just have to wait for it to complete. You have 3 million points to analyze.

Re: Arcgis very slow

DanPatterson_Retired — Thu, 21 May 2015 17:48:16 GMT

if you have fewer countries than species you could partition by country or even continent. try to get your workflow for one condition, then you can automate. for example some bird species summer in Canada and winter south of the equator...there is little point in having India or Australia in the spatial mix