Micro-Agent: Beat Frontier Models with Collaboration Inside Model API
Summary
This article discusses moving from model selection to collaboration inside the model API via the vLLM Semantic Router. It introduces a Looper runtime and several collaboration patterns (Confidence, Ratings, ReMoM, Fusion, Workflows), and argues for open serving primitives that enable multi-model coordination under a single API surface with defined recipes and output contracts.