Bifrost
by Maxim AI
Routes LLM requests across 23+ providers through one OpenAI-compatible API, with automatic failover, load balancing, semantic caching, MCP tool access, and budget governance.
Skills
Route Across Providers
Routes chat completion and embedding requests to 23+ model providers through a single OpenAI-compatible HTTP endpoint.
Fail Over Automatically
Falls back to backup providers, models, and API keys automatically when a request errors, with load balancing across keys.
Cache Responses Semantically
Serves cached responses when an incoming prompt is semantically similar to an earlier one, cutting token spend and latency.
Gateway MCP Tools
Connects models to external MCP tools such as filesystem, web search, and databases through the gateway MCP layer.
Enforce Budgets And Limits
Tracks usage and enforces hierarchical budgets, rate limits, and access control using virtual keys scoped to teams and customers.
Related Agents
Kong AI Gateway
Governs and meters LLM and agent traffic through a high-performance API gateway, with an MCP gateway that turns existin…
Agent Substrate
Runs agents in secure-by-default microVM sandboxes on GKE, delivering high sandbox density and sub-second resume throug…
CrewAI
Multi-agent orchestration framework for building teams of AI agents that collaborate, delegate, and solve complex tasks…
IBM ContextForge
Runs a self-hosted gateway and registry that federates MCP servers, A2A agents, and REST/gRPC APIs behind one endpoint…