Training a Text-to-Image Model for $21K
Summary
A detailed field notes post about training a text-to-image model (Pyramid-JiT) for around $21K. It covers the architecture, training regime, dataset size, compute costs, limitations, and authorship workflow, illustrating how a small team built a 2B-parameter model with a 600M+ sample regime and open-source artifacts.