DigiNews

Tech Watch by Johan Denoyer

← Back to articles

Livenerf: Has Opus 5.5 been nerfed yet?

Quality: 8/10 Relevance: 9/10

Summary

The article introduces livenerf, a deterministic benchmark for detecting post-launch capability drift in frontier models, focusing on Opus 5.5. It outlines the setup, methodology, calibration, and validation, and notes that results are published with pre-registered plans and public logs. The project emphasizes transparency and reproducibility in evaluating model performance over time.

🚀 Service construit par Johan Denoyer