What Do Benchmarks Actually Measure?

Benchmarks are useful only when someone actively tries to break them

New blogpost: What does your benchmark actually measure? I argue what evals end up measuring is the simplest way to improve performance on them. When building a new benchmark, we are often too focused on minimizing scores at launch.