LLM Architecture Gallery
Summary
Sebastian Raschka's LLM Architecture Gallery catalogs a comprehensive set of large language model architectures from recent open-weight releases and major papers. The page links to model-specific figures and technical sheets across dense, MoE, MLA, and hybrid decoder designs, with dates from 2024-2026 and references to source articles. It's a valuable reference for understanding current architectural trends and design choices in open-weight LLMs.