vllm-project/vllm
Summary
vLLM is a high-throughput and memory-efficient inference and serving engine for large language models. The project highlights extensive model support, advanced features like PagedAttention and various quantization options, and broad deployment capabilities. It emphasizes open-source collaboration, documentation, and community engagement around efficient LLM serving.