DigiNews

Tech Watch by Johan Denoyer

← Back to articles

BerriAI/litellm

Quality: 8/10 Relevance: 9/10

Summary

LiteLLM is an open-source AI gateway that unifies access to 100+ LLM providers through a single OpenAI-compatible interface. It offers a Python SDK and a proxy gateway for production-grade deployments, including features like virtual keys, per-project spend tracking, guardrails, and load balancing. The project provides extensive deployment options for AWS and GCP, developer setup guidance, and a comprehensive list of supported providers.

🚀 Service construit par Johan Denoyer