Bryan Cantrill posted an important blog entry about the problems with benchmarking in general, NAS benchmarking more specifically, and the current industry standard SPEC SFS bencmark in detail. In summary, the current “standard” NAS performance benchmark is worse that useless or missleading, it encourages NAS vendors to engineer NAS solutions are overpriced and underperforming, just to get better benchmark numbers. Have a look:
Eulogy for a benchmark : The Observation Deck.
