Claude was faster and cheaper. We took the scenic route anyway
Summary
This Grainulation note investigates a verification-first approach to multi-model QA. Five local LLMs answer questions with sources, and a separate checker evaluates whether cited passages support the answers, leading to improvements and some failures. The work also compares cost and reproducibility versus relying on a single model via Sonnet, highlighting when reruns can avoid additional model calls.