BerriAI/litellm
Summary
LiteLLM is an open-source AI gateway that unifies access to 100+ LLM providers through a single OpenAI-compatible interface. It offers a Python SDK and a proxy gateway for production-grade deployments, including features like virtual keys, per-project spend tracking, guardrails, and load balancing. The project provides extensive deployment options for AWS and GCP, developer setup guidance, and a comprehensive list of supported providers.