Open-source LLM gateway

One API for every model.Route with confidence.

Reliable routing, budgets, and request logs.Your keys. Any model. No code rewrites.

Hosted or self-hostedBring your own keysOpenAI client compatible
Product preview

Production traffic

Last 24 hours
Requests
18,920
+8.4%
Provider cost
$128.42
$0.0068 avg
P95 latency
841ms
−94ms
Fallbacks
2.7%
512 requests
Provider cost
USD
Recent requests
openai/gpt-4o-mini200$0.006612ms
anthropic/claude200$0.012928ms
google/gemini200$0.004481ms
custom/local429$0.000108ms

Built-in adapters for the providers you already use

OpenAI logo
Anthropic logo
AWS Bedrock logo
Azure OpenAI logo
Azure AI Foundry logo
Google AI Studio logo
Google Vertex AI logo
Groq logo
xAI logo
DeepSeek logo
Mistral AI logo
Perplexity logo
Cerebras logo
Canopy Wave logo
Alibaba Cloud Model Studio logo
Z AI logo
Moonshot AI logo
Together AI logo
NovitaAI logo
Nebius Token Factory logo
NanoGPT logo
BytePlus ModelArk logo
MiniMax logo
Inference.net logo
EmberCloud logo
Xiaomi MiMo logo
Avalanche logo
Glacier logo
Quartz logo
OpenAI logo
Anthropic logo
AWS Bedrock logo
Azure OpenAI logo
Azure AI Foundry logo
Google AI Studio logo
Google Vertex AI logo
Groq logo
xAI logo
DeepSeek logo
Mistral AI logo
Perplexity logo
Cerebras logo
Canopy Wave logo
Alibaba Cloud Model Studio logo
Z AI logo
Moonshot AI logo
Together AI logo
NovitaAI logo
Nebius Token Factory logo
NanoGPT logo
BytePlus ModelArk logo
MiniMax logo
Inference.net logo
EmberCloud logo
Xiaomi MiMo logo
Avalanche logo
Glacier logo
Quartz logo
OpenAI logo
Anthropic logo
AWS Bedrock logo
Azure OpenAI logo
Azure AI Foundry logo
Google AI Studio logo
Google Vertex AI logo
Groq logo
xAI logo
DeepSeek logo
Mistral AI logo
Perplexity logo
Cerebras logo
Canopy Wave logo
Alibaba Cloud Model Studio logo
Z AI logo
Moonshot AI logo
Together AI logo
NovitaAI logo
Nebius Token Factory logo
NanoGPT logo
BytePlus ModelArk logo
MiniMax logo
Inference.net logo
EmberCloud logo
Xiaomi MiMo logo
Avalanche logo
Glacier logo
Quartz logo
One control plane

The provider layer your app does not have to own.

BerryRouter puts routing, credentials, usage policy, and request data behind one API, so application code stays simple while operators keep control.

Health-aware fallback
Score eligible providers with live health and latency, then work through the fallback order.
Budgets that stop traffic
Enforce spend and rate limits by organization, project, API key, provider, or model.
Request-level truth
Trace provider attempts, tokens, cost, latency, errors, prompts, and responses in one place.
Keys and policy in one plane
Keep BYOK credentials encrypted and scoped alongside access rules, guardrails, and retention.
How routing works

Send one request. BerryRouter finds a healthy path.

Each call passes project access, budget, rate-limit, and guardrail checks. BerryRouter then scores eligible providers with live health data and records every attempt.

1

Apply policy

Reject requests that exceed access, budget, or rate-limit rules.

2

Select a provider

Honor explicit routes or choose from the eligible fallback order.

3

Record the result

Tie attempts, tokens, cost, latency, and payload retention to one request ID.

Your appOne request
BerryRouter
OpenAI
Anthropic
Google AI Studio
AWS Bedrock
Health + policy checked
Drop-in API

Keep your client. Change the base URL.

Use the OpenAI client you already know. BerryRouter keeps provider selection, credentials, policy, and telemetry out of application code.

OpenAI-style authentication and request bodies
Streaming, tool calls, Responses, image, audio, and video routes
One request ID from application error to provider attempt
Python
from openai import OpenAI

client = OpenAI(
    base_url="https://api.berryrouter.ai/v1",
    api_key="brk_live_..."
)

response = client.chat.completions.create(
    model="openai/gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello"}],
    stream=True
)
Same client
One API key
Every request logged
Two deployment modes

Use the service. Or own the stack.

Start on BerryRouter’s hosted platform or run the gateway and control plane in your infrastructure. The API surface stays the same.

BerryRouter Cloud
Hosted
We operate the gateway, control plane, workers, and data services. Organizations can use prepaid credits or their own provider keys.
No infrastructure to run
Organization and project workspaces
Credits or BYOK billing mode
Self-hosted
BYOK only
Run the gateway, control plane, worker, and dashboard in your own environment. Provider keys and operational data stay under your control.
Portable Docker deployment
Postgres, Redis, and ClickHouse
Optional S3 payload storage
FAQ

Straight answers before you route traffic.

The product is one gateway, with different operating models for teams that want a managed service or their own deployment.

Route your first request

Put one clear control point between your app and every model.

Create a project, add a provider key, issue an API key, and trace the first request from the same console.