LLMs are making formal software verification feasible at a much larger scale
Summary
Anthropic's Frontier Red Team describes using Claude to perform formal verification at scale on real-world software, producing assembly-level security proofs for RISC-V across OSS-Fuzz libraries. The work demonstrates scalable AI-assisted verification, reveals multiple bugs, and outlines limitations and future directions for expanding semantics to more architectures and environments.