Zonal statistics as Table is the appropriate tool.
Is your dataset extremly large?
Does your polygon layer have many classes that you are evaluating?
When does it crash, and what is the error message generated in the Geoprocessing Results window?
You could try limiting the analysis to a single polygon class, and see if that works.
Best Regards,
Jim