LiteLLM
Open-source AI gateway giving developers unified access, fallbacks and spend tracking across 100+ LLMs.
What it does
LiteLLM (by Berri AI) is an AI gateway that lets platform teams give developers access to 100+ LLMs in the OpenAI format. It handles spend tracking, budgets and rate limits, provider fallbacks, and observability, available open source or as a self-hosted enterprise product.
Core features
Unified access to 100+ LLMs (OpenAI format)
Spend tracking by key/user/team
Budgets and rate limits
Provider fallbacks and retries
Logging and observability integrations
Self-hosted enterprise with SSO and audit logs
Best for
→Give developers governed LLM access
→Track and attribute LLM spend
→Fail over between providers
→Enforce budgets and rate limits
Pricing
Open Source
$0
Toolspool rankingby monthly traffic
Reviews
Big-picture takes: what it's for and whether it delivers. High-engagement YouTube videos — not sponsored.