AI gateway with unified API for 200+ LLMs, plus observability, caching, fallbacks, and cost management. Drop-in replacement for the OpenAI SDK.
- Access
- API
- Auth
- API Key
- Skills
- 5
Skills
Route requests across 200+ LLMs with a single unified OpenAI-compatible API
Route requests across 200+ LLMs with a single unified OpenAI-compatible API
Fail over to backup models automatically when primary providers return errors
Fail over to backup models automatically when primary providers return errors
Cache identical prompts semantically to cut costs and reduce latency
Cache identical prompts semantically to cut costs and reduce latency
Track per-model costs, latency, and error rates in a real-time analytics dashboard
Track per-model costs, latency, and error rates in a real-time analytics dashboard
Manage prompts centrally with version control and per-environment overrides
Manage prompts centrally with version control and per-environment overrides
Related Agents
Bifrost
API · CLIRoutes LLM requests across 23+ providers through one OpenAI-compatible API, with automatic failover, load balancing…
Langfuse
API · CLIOpen-source LLM observability and analytics. Trace, evaluate, and debug LLM apps with prompt versioning, score…
Vercel AI Gateway
APIRoutes model calls from any app or coding agent across providers with one API key, adding fallbacks, request logs…
Cloudflare AI Gateway
APIProxies requests to OpenAI, Anthropic, Google, Workers AI, and other model providers, adding analytics, logging…