Added Oct 28, 2026
LiteLLM
FreemiumOpen-source gateway to call 100+ LLM providers in OpenAI format
What is LiteLLM?
LiteLLM is an open-source Python SDK and proxy server that lets you call more than a hundred LLM providers using the OpenAI request format. Platform teams use the proxy as an internal AI gateway with keys, budgets, rate limits and logging.
The proxy handles load balancing, fallbacks between providers, spend tracking per team or key and integrations with observability tools like Langfuse. The SDK is a drop-in way to switch providers in code.
The open-source version is free to self-host with Docker and a Postgres database. An enterprise license adds SSO, audit logs, advanced guardrails and dedicated support.
Features
- OpenAI-format SDK
- Proxy gateway
- Budgets and rate limits
- Provider fallbacks
- Spend tracking
Tags
Releases
+ Submit new release- Listed
LiteLLM was added to the directory.
Organization
BerriAI
🇺🇸 United States
Listed by kitio.ai · unverified owner
Pricing
- Pricing model
- Freemium
- Paid options from
- Not listed
LiteLLM plans
Open Source
Free
- Self-hosted
- 100+ providers, one OpenAI API
- Virtual keys, budgets, rate limits
- Spend tracking and fallbacks
Enterprise
Contact sales
- Annual contract
- Air-gapped deployment
- 30-day trial key
Prices in USD, checked Oct 28, 2026. Plans change often, so confirm on the LiteLLM site.Official pricing
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.
Top LiteLLM alternatives
View allModels & APIs
Gradio web interface for running local LLMs with many backends
Models & APIs
Open-source AI gateway and LLM observability platform
Models & APIs
Kubernetes-native MCP and AI gateway platform for enterprise agents
Compare LiteLLM
If you liked LiteLLM
Open-source chat platform unifying many model providers
FreeChat assistantsMade in United StatesSource-available workflow automation you can self-host
Freemium · $24/moAgents & automationMade in GermanyOpen-source, model-agnostic coding agent for the terminal
Freemium · $10/moCodingMade in United StatesOpen-source personal AI agent you run on your own machine
FreeAgents & automation3 views1 clicks to the website
Pros and cons
Pros
- Supports a huge provider list
- Free to self-host
- Good cost controls
Cons
- Fast releases can bring bugs
- Config gets complex at scale
- Enterprise features are paid
Prompts & results
No prompts yet. Add your own prompt and output to help others use this tool.
Share a prompt
Reviews
Q&A
What is LiteLLM?
LiteLLM is an open-source Python SDK and proxy server that lets you call more than a hundred LLM providers using the OpenAI request format. Platform teams use the proxy as an internal AI gateway with keys, budgets, rate limits and logging.
How much does LiteLLM cost?
LiteLLM is freemium.
Is there a free version of LiteLLM?
Yes. LiteLLM has a free plan, and paid plans add more usage and features.
What are the main features of LiteLLM?
OpenAI-format SDK, Proxy gateway, Budgets and rate limits, Provider fallbacks, Spend tracking.
Who makes LiteLLM?
LiteLLM is made by BerriAI.
What are the best alternatives to LiteLLM?
Popular alternatives include text-generation-webui, Helicone, LocalAI.