Better Models: Worse Tools
Summary
A detailed examination of how LLM tool-calling works, why newer Claude models produce malformed tool-call payloads, and the implications for tool schemas, harnesses, and constrained decoding. The piece discusses Pi's edit tool, the concept of grammar-aware decoding, and the contrast with Claude Code's harness, suggesting stricter schema enforcement to mitigate issues.