OpenRouter invented the LLM gateway category, and it's still the first thing most developers reach for when they want one API key for every model. Fair enough: the catalog is enormous, uptime is solid, and the developer experience set the standard everyone else copied — including us. But first and biggest are not the same as right for your workload. If you're pushing real token volume in 2026, have compliance constraints, or care who controls the routing decision, the calculus has shifted. Here's the comparison — including the cases where OpenRouter, or self-hosting, is still the correct answer.
One thing changed the math for everyone: frontier-class open-weight models. DeepSeek V3.2 lists at roughly $0.28 in / $0.42 out per 1M tokens; Kimi K2 and GLM-4.6 list under $3 out. When models that cheap match Claude or GPT on a large share of production workloads, the gateway stops being a convenience and starts deciding your unit economics.
The six options
- OpenRouter — the category pioneer. Hundreds of models behind one OpenAI-compatible API, prepaid credits, roughly a 5% fee on top of provider list prices.
- Requesty — a younger aggregator with the same shape: unified API, routing policies, credit billing with a platform fee at the time of writing.
- LiteLLM — the open-source proxy you self-host. Free software, total control, traffic never leaves your infrastructure. You run it, you page yourself.
- Portkey — a gateway attached to a serious observability product: traces, evals, guardrails, declarative routing configs. Tokens bill to your own provider keys.
- Direct provider APIs — no middleman, provider-specific features on day one, and N separate bills, SDKs, and failure modes for N vendors.
- INFRO — that's us. One OpenAI-compatible API, 120+ models, pricing at or below provider list rather than list-plus-fee. We'll flag our bias where it matters.
Catalog breadth
OpenRouter wins here outright. Community fine-tunes, roleplay models, tiny experimental releases, day-one access to whatever dropped on Hugging Face this morning — if breadth is the feature, buy breadth. INFRO carries 120+ models chosen for production: the frontier closed models (GPT-5.1, Claude Opus 5 and Sonnet 5, Gemini 3 Pro) plus the open-weight models people actually deploy (DeepSeek, Qwen3-Max, Kimi K2, GLM-4.6, Llama 4) — the full list is at /models. Requesty covers the major labs and popular open weights with a shorter tail. LiteLLM's catalog is whatever you wire up: 100+ providers as integrations, each one your configuration to maintain. Portkey is similar — broad support, your keys. Direct APIs give you one vendor's models.
Pricing models: where they differ
OpenRouter and Requesty charge provider list price plus a fee — roughly 5% when you load credits on OpenRouter, a bit more by card. LiteLLM is free software: you pay providers list price directly, plus infrastructure, plus the engineering time to run a proxy in the request path — the line item people forget. Portkey charges a platform fee while tokens bill straight to your provider accounts. Direct APIs are list price unless you can negotiate committed-use discounts — real, but they come with volume commitments and single-vendor gravity. INFRO buys capacity in volume and prices at or below provider list; details are on the pricing page.
A worked example
One RAG-heavy workload we modeled: 1B input + 150M output tokens a month. On DeepSeek V3.2 that's roughly $343/month at list — a 5% fee adds about $17, and nobody should care. The same shape on Claude Sonnet 5 ($3/$15) is about $5,250/month at list; the fee is now roughly $260/month, and below-list pricing swings the gap by hundreds more the other way. The fee is proportional to spend. That's the entire story.
A percentage fee is a rounding error on a side project and a line item your CFO circles at scale. No vendor blog post or Hacker News thread changes that arithmetic — only your monthly invoice does.
Routing control and failover
OpenRouter gives you provider preference ordering, price- and throughput-optimized variants, and fallback model arrays. It works, but the knobs are coarse and the routing logic is ultimately theirs. LiteLLM is the opposite extreme: cost-based, latency-based, weighted routing, cooldowns, health checks — all yours to configure, tune, and debug at 3am. Portkey sits between, with declarative configs: fallbacks, load balancing, canary rollouts. Direct APIs give you nothing; most hand-rolled failover is a try/except and a prayer, first tested during a provider incident. INFRO routes each request to the cheapest provider that meets a reliability threshold, fails over across providers automatically, and lets you pin providers or define explicit fallback chains when you need determinism.
Whichever gateway you pick, integration is the same trick — an OpenAI-compatible endpoint means the switch is a base URL:
import os
from openai import OpenAI
client = OpenAI(
base_url="https://api.infro.io/v1",
api_key=os.environ["INFRO_API_KEY"],
)
# Same code you already have. Only the model string changes.
resp = client.chat.completions.create(
model="deepseek/deepseek-v3.2",
messages=[{"role": "user", "content": "Summarize this ticket thread."}],
)Analytics and observability
Portkey is the strongest here: it's an observability product with a gateway attached, not the reverse. Full traces, evals, guardrails. OpenRouter's per-key activity dashboards are clean and enough for most teams. LiteLLM emits to Langfuse, Datadog, or Prometheus — maximally flexible, entirely self-assembled. INFRO ships per-key, per-model, per-provider cost and latency analytics out of the box — what you need to answer "what did feature X cost last week" without exporting anything. Direct APIs mean one console per vendor and a spreadsheet to reconcile them.
Enterprise features and data policies
Self-hosted LiteLLM has the strongest data story, full stop: request traffic never transits a third party. If your security team requires that, the rest of this comparison is moot. OpenRouter lets you exclude providers by data policy — including providers that may train on inputs — and prompt logging is opt-in. Portkey offers SOC 2 and hybrid deployment options. INFRO gives you per-key provider allowlists and doesn't train on your data; for specific certifications or region-pinned routing, check the current state in the docs rather than a blog post's snapshot. To be fair to the incumbents: going direct to a single lab is often the easiest path through enterprise procurement — their legal terms are the ones your counsel has already read.
Side by side
| Catalog | Pricing | Routing control | Failover | Analytics | Best fit | |
|---|---|---|---|---|---|---|
| OpenRouter | Largest, incl. long tail | List + ~5% credit fee | Provider prefs, fallbacks | Automatic, cross-provider | Good dashboards | Breadth, prototypes, exotic models |
| Requesty | Major labs + popular open weights | List + platform fee | Routing policies | Automatic | Basic dashboards | OpenRouter-style UX; price-compare it |
| LiteLLM (self-hosted) | Whatever you wire up | Free OSS + list + infra + time | Total — it's your config | Yours to build and tune | Via Langfuse/Datadog etc. | VPC-only traffic, compliance |
| Portkey | Broad, via your own keys | Platform fee; tokens billed direct | Declarative configs, canaries | Configurable fallbacks | Deepest: traces, evals | Observability-first teams |
| Direct APIs | One vendor | List; discounts at commitment | None | DIY | Per-vendor consoles | Single-model shops, negotiated deals |
| INFRO | 300+, production-focused | Below provider list | Cost-first default, pinning, chains | Automatic, cross-provider | Per-key cost + latency | Multi-model production at volume |
Which should you pick
- Pick OpenRouter if breadth is the feature — community fine-tunes, day-one exotic releases — or you spend $200/month, where the fee is $10 and optimizing it wastes your time. It's a genuinely good product.
- Pick LiteLLM if a regulator or security team says no third party in the request path and you have platform engineers who can own a proxy. This is the right answer more often than gateway vendors admit.
- Pick Portkey if observability, evals, and guardrails are your actual problem and routing is secondary.
- Pick Requesty if you want an OpenRouter-shaped product and its pricing works for your model mix — run the numbers on your own traffic, not a landing page.
- Stay direct if you're committed to one model family, lean on provider-specific features (fine-tuning, batch APIs, caching semantics), or negotiated a committed-use discount that beats any aggregator. Those deals exist and they're good.
- Pick INFRO if you run several models in production — say Sonnet 5 for the hard 20% and DeepSeek V3.2 or Kimi K2 for the cheap 80% — and your spend is high enough that percentage points are real money. Below-list pricing plus cost-first routing is the combination the others don't offer.
If you're in that last bucket, switching costs about five minutes: change the base URL, pick models from the catalog, ship. The quickstart covers it. And if OpenRouter's fee currently costs you less than one engineer-hour a month — stay put until it doesn't.