Benefits and Liabilities
Good benchmarks
- Define the playing field
- Accelerate progress
- Engineers do a great job once objective is measurable and repeatable
- Set the performance agenda
- Measure release-to-release progress
- Set goals (e.g., 10,000 tpmC, < 50 $/tpmC)
- Something managers can understand (!)
Benchmark abuse
- Benchmarketing
- Benchmark wars
- more $ on ads than development