Bye Bye Perspective API: Lessons for Building and Governing Measurement Infrastructure
Summary
This arXiv paper analyzes the end-of-life of Perspective API and argues that researchers must build and govern their own measurement infrastructure for NLP/LLM evaluation. It surveys 241 papers using Perspective, highlights issues such as model retraining shifts and unexplainable disparities, and provides a dataset-backed set of requirements for durable measurement pipelines.