Kolibri Has Landed: A Sovereign Open-Weight Model
Summary
Aleph Alpha announces Kolibri, a sovereign open-weight language model: a German-English Mixture-of-Experts transformer with 78B total parameters (3B active) and up to 1M token context. The model is released under Apache 2.0, emphasizes on-prem deployment and end-to-end sovereignty, and is backed by a reproducible training pipeline, grounding features to reduce hallucinations, and domain-specific evaluations. The article covers architecture details, German data strategies, tokenization innovations, and post-training methodologies.