OmniRoute / Product capabilities

Controls you can inspect and self-host.

Review the gateway controls, platform services and local dashboard without treating a feature list as a hosting promise.

Review capabilities Start with Cheaper Inference Back to overview

Core controls

What ships with the self-hosted gateway.

Keep requests moving

When a target is unavailable or out of quota, OmniRoute selects the next healthy target.

Compress eligible context

A 12-engine pipeline reduces eligible context by 15–95%. The documented tool-heavy example reduced it by ~89%.

$0 to start

90+ free tiers and 56 recurring or keyless free-forever providers. No credit card needed for the keyless quick start.

35 supported integrations

Configure Claude Code, Codex, Cursor, Cline, Copilot, Antigravity and other supported clients through one endpoint.

One endpoint

Accept OpenAI, Claude, Gemini and Responses API requests at `/v1`.

Operational controls

Circuit breakers, encrypted credentials, MCP, A2A, memory, guardrails and evals ship with the self-hosted gateway.

Capabilities

Configure the request path from one dashboard.

Configure fallback, quota, compression, memory, MCP and A2A from the local dashboard.

Smart Combos

Set a model to `auto` or build your own combo with 19 strategies and tiered fallback.

Use a ready-made mode or combine 19 strategies around the goal that matters.

Memory

Persistent conversational memory with FTS5 keyword and Qdrant vector recall.

3-layer resilience

Provider breaker, connection cooldown and model lockout isolate failures at the smallest useful scope.

Free quota

Pool-deduped accounting across 90+ free tiers.

Published free-tier capacity, deduplicated.

Compression

12 composable engines for tool output, context and response style.

Reduce eligible tokens by 15–95%.

MCP server

A built-in server exposing 110 gateway tools across 33 scopes.

110 tools · 33 scopes · stdio / HTTP

A2A protocol

A JSON-RPC agent server with 6 skills.

6 skills · JSON-RPC 2.0 · Agent Card

CombosResilienceFree quotaCompressionMCPA2AMemoryProxy controlsGuardrailsCloud agentsEvalsSemantic cacheSkillsAnalytics

Platform services

Extend the local gateway.

Embedded services

Run Bifrost, 9Router or CLIProxy as managed sidecars, or operate a full cluster profile.

Your knowledge, in context

Connect Notion and Obsidian as MCP-backed context sources.

Guardrails built in

Prompt-injection checks, opt-in PII redaction and normalized safety filters without provider lock-in.

Usage goals

Track streaks, achievements and live savings alongside operational analytics.

Dashboard

Inspect configuration and example operating views.

The values below are example data. Your local dashboard reflects your own providers, requests and costs.

localhost:20128/dashboardExample data

352providers connected

90+free tiers available

198healthy in this example

Claude Code · OAuth · live
Cerebras · free · live
Groq · cooldown example
NVIDIA NIM · free · live