Hello,
Benchmark should consist of Map/Geoprocessing/Geocoding/OGC services and tools to probe the performance.
This would allow us to understand how much performance is improved from version to version.
Standard ESRI provided/generated data set would be used in benchmark.