Aleph Alpha Kolibri: How the Sovereign German LLM Works
Summary
The article introduces Aleph Alpha Kolibri, a sovereign open-weight MoE LLM for German and English, with 78.1B total parameters and about 3.5B active per token. It details the architecture, tokenizer, long-context capabilities, German-only reasoning, retrieval-augmented generation, evaluation results, how to run it, and appropriate use cases, highlighting its on-prem deployment and regulatory considerations.