Can LLMs Perform Deep Technical Comprehension of Computer Architecture Papers?
Summary
A study of Gauntlet, an open-source multi-agent pipeline that analyzes computer architecture papers with five expert personas and an adversarial synthesis stage. On 20 ISCA 2025 and HPCA 2026 papers, Gauntlet often matched or surpassed human analysis, with the biggest gains in structured critique, driven by its synthesis pass. The authors release analyses, scores, and rubrics as a community resource.