Watermarking in vLLM
Summary
This article explains how text provenance can be achieved without distorting model outputs by watermarking LLM generation using a Gumbel-max scheme. It covers detection methods, robustness and throughput considerations, speculative decoding challenges, and how watermarking is implemented in vLLM.