DigiNews

Summary

Recurrent Looped Transformer (RLT) proposes a transformer variant with a causal encoder and a recurrent decoder that carries its final hidden state and a sliding-window attention cache across tokens. The work emphasizes latent reasoning with potentially unbounded temporal depth and combines model, hardware, and RL co-design ideas, outlining architecture, execution schedules, and practical considerations.