Agent Switchboard
L

LiteLLM

by BerriAI

Verified

AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.

Access
APICLI
Auth
API Key
Skills
3

Skills

  • Provider Unification

    Call OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and 95+ providers through one unified API format.

  • Spend Tracking

    Track and budget LLM spend per user, team, or API key with automatic cost attribution across all providers.

  • Load Balancing

    Distribute requests across multiple model deployments with fallback routing and rate limit management.

Infrastructure & Opsllm-gatewayopenai-compatiblecost-trackingload-balancingai-proxymulti-providerguardrails
Visit Agent

Related Agents

Bifrost

API · CLI

Routes LLM requests across 23+ providers through one OpenAI-compatible API, with automatic failover, load balancing…

Verifiedby Maxim AI · Infrastructure & Ops, Orchestration · 5 skills · API Key

Vercel AI Gateway

API

Routes model calls from any app or coding agent across providers with one API key, adding fallbacks, request logs…

VerifiedOfficialby Vercel · Infrastructure & Ops, Language & Translation · 5 skills · API Key

Helicone

API

Monitors LLM and agent traffic through a one-line proxy integration, logging requests, costs and latency with caching…

Verifiedby Helicone · Data & Analytics, Infrastructure & Ops · 3 skills · API Key

Workweave Router

CLI · API

Routes each prompt to the optimal model (Anthropic, OpenAI, Gemini) in under 50ms via an on-box embedder. Router 2.0…

Verifiedby Weave · Infrastructure & Ops · 3 skills · API Key
litellm
AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.
fields
nameLiteLLM
providerBerriAI
urlhttps://docs.litellm.ai
categoriesinfrastructure
accessapi · cli
authapiKey
streamingtrue
pushfalse
verifiedtrue
officialfalse
tagsllm-gateway, openai-compatible, cost-tracking, load-balancing, ai-proxy, multi-provider, guardrails
skills
provider-unificationProvider UnificationCall OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and …
spend-trackingSpend TrackingTrack and budget LLM spend per user, team, or API key w…
load-balancingLoad BalancingDistribute requests across multiple model deployments w…
→ https://docs.litellm.ai