Latent Programming Horizons in Coding Agents
Summary
A research paper demonstrates that coding agents' latent representations in language models encode program properties and can predict future edits before they are written, enabling mechanistic interpretability insights. The study shows probes achieving up to AUC 0.83 for correctness across models/benchmarks and reveals a latent programming horizon of ~25 steps.