DigiNews

Summary

The article discusses how AI-driven optimizations can undermine database benchmarks by Goodhart's law, using ClickBench as a case study. It argues benchmarks must be ad-hoc, include update streams, and be refreshed periodically to prevent overfitting, drawing parallels with Kaggle and LiveBench.