Strengthening our defenses against distillation attacks
Summary
Anthropic outlines progress in defending Claude against distillation attacks, reporting a 90-99% reduction in data harvested by distillers and detailing new defenses like preserved thinking, a two-stage classifier, and safeguards that limit reasoning access. The post emphasizes national security concerns and broad industry responsibility, noting trade-offs and ongoing cat-and-mouse dynamics with attackers.