Show HN: Jevstiller – Distill Jev into a local model, with a disagreement bound
Summary
Show HN: Jevstiller introduces a system that distills a small local model from Jev’s outputs to answer a large fraction of requests while bounding disagreement. The contract uses A = 1 − c·e to manage coverage (c) and disagreement (e), aiming to keep the overall mismatch within a budget. The article details four design decisions, the concept of confidence floors, ongoing auditing, and the practical costs and trade-offs of deploying such a locally hosted model.