OpenMythos: A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature
Summary
OpenMythos is a theoretical, open-source reconstruction of Claude Mythos that outlines a Recurrent-Depth Transformer with three stages: Prelude, Recurrent Block, and Coda. It discusses switchable attention (GQA or MLA), a sparse MoE in the recurrent block, and stability techniques ensuring a spectral radius below 1. The piece also covers training scalability, loop-index embedding ideas, and arguments that deeper reasoning can be achieved through looping rather than sheer parameter counts.