Hello Marsha,
What version of ArcGIS (service pack?) are you running?
What are the formats of your data? (ie, file geodatabase raster, etc...).
If FGDB raster input can you try converting the rasters to GRID (if possible) and comparing the times.
Thank you,
-Ryan