The central concept behind benchmarks was historically pretty simple. What's the horsepower of some vendor's "Big Iron"? After all, most systems--the important ones, anyway--were the big boxes sitting in a data center someplace doing important stuff like booking orders or counting money.
They cost a lot. They were based on proprietary architectures that made low-level technical comparisons between vendors difficult. And they were a core part of an enterprise's business.
This was largely the environment that spawned the benchmark business. Ideally, buyers would run their own tests, using their own applications, but this was difficult … Read more