📦
Litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
0 installs
37.2K stars
6K forks
Trust: 92 — Excellent
Ai
Installation
npx litellmAsk AI about Litellm
Powered by Claude · Grounded in docs
I know everything about Litellm. Ask me about installation, configuration, usage, or troubleshooting.
0/500
Loading tools...
Reviews
Documentation
No README available