Skip to content

Alternatives

Cloudflare AI Gateway alternatives: when to stay, and when to move

If your traffic already runs through Cloudflare, stay: AI Gateway's core features are free, it caches, logs, rate-limits and falls back between models, and its spend limits count your own-key traffic. Teams move when they need spend limits that hold under concurrent load, budgets and attribution across projects, teams and end customers, or routing for more than OpenAI-shaped chat; INFRO, Vercel AI Gateway, OpenRouter, LiteLLM and Portkey each fit one of those reasons.

By INFRO Editorial

Last updated

Last checked

On this page
  1. What Cloudflare AI Gateway does well
  2. The lines teams reach later
  3. The alternatives, by reason
  4. Using Cloudflare and a control plane together
  5. Which one to choose
  6. What INFRO adds behind or instead of Cloudflare
  7. Questions
  8. Sources

What Cloudflare AI Gateway does well

  • A free core. Analytics, logging, caching and rate limiting at no charge; legacy logs are capped at 100,000 across all gateways on Workers Free and 10,000,000 per gateway on Workers Paid.
  • Your own keys, no fee. Stored keys (BYOK) carry no fee. Paying through Cloudflare's Unified Billing instead adds 5% on each purchase.
  • Spend limits that see BYOK. They count Unified Billing and BYOK requests for models with known pricing, and answer 429 at the limit.
  • Fallbacks and dynamic routing. The Universal endpoint falls back on error; dynamic routing builds flows with conditions, rate-limit and budget nodes, visually or as JSON.

For one team on Cloudflare, that is a complete answer.

The lines teams reach later

You needWhat Cloudflare documents
A hard spend cap under concurrent loadSpend limits are eventually consistent: a burst of concurrent requests can briefly pass them
Caching of similar, not identical, promptsCaching is exact-match only, for text and image responses; semantic caching is planned
Rate limits per key, team or customerRate limits are set per gateway and applied uniformly to its requests
Projects, roles and an audit log across teamsThe unit is the gateway, governed by Cloudflare account roles
From Cloudflare's AI Gateway docs, read on the date at the top.

None of these is a flaw in a free product. They are the point at which a gateway stops being a utility and becomes an organization's control layer.

The alternatives, by reason

Each option is described from its own pricing page and documentation. INFRO is listed first because this is INFRO's site; its limits are listed as plainly as everyone else's.

Who it is for
Teams that hold, or want to hold, their own provider contracts and need routing, failover, budgets and cost per customer across them.
How it charges
A flat plan of $35–$599 a month, chosen by request volume (100K–10M requests a month), never by spend. 0% markup on model spend: your providers bill you directly.

Strengths

  • Every request runs on a provider account you own; INFRO holds none, so nothing falls back onto someone else's contract.
  • Budgets refuse a request before the provider is called, per organization, project, member and key, and (from the Team plan) per end customer.
  • Each response names the provider, connection and model that served it, with an estimated provider cost.

Limits

  • No shared capacity: when every connection you own fails, the request fails with an error that says why.
  • Hosted only on its plans; a self-hosted deployment needs an enterprise agreement.
  • No prompt management or output evaluation.
  • Costs a subscription where Cloudflare's core is free.
  • Its response cache covers chat completions only.
Who it is for
Teams building on Vercel and the AI SDK who want the gateway in the same dashboard.
How it charges
No markup and no platform fee on tokens, including with your own keys. Some capabilities are paid add-ons.

Strengths

  • List-price tokens with no gateway fee.
  • The AI SDK uses it by default when you pass a model string.

Limits

  • When a request on your own credentials fails, Vercel retries it on its own system credentials and charges your AI Gateway balance.
  • Budgets do not count spend on your own keys, so they cannot cap BYOK traffic.

Full comparison with Vercel AI Gateway

Who it is for
Teams that want hundreds of models behind one key and one balance, without an account at each provider.
How it charges
5.5% on each balance purchase (8% on Business). With your own keys: no fee on the first $25,000 a month of list-price usage, then 5%.

Strengths

  • 500+ models, 80+ providers behind one API key.
  • Inference at each provider's list price, with routing and fallbacks between providers.

Limits

  • The fee grows with your spend, and your negotiated rates do not apply to its balance.
  • With your own keys, a failed request falls back to OpenRouter's shared capacity by default.

Full comparison with OpenRouter

Who it is for
Teams that want no vendor in the request path and have engineers to run a production service.
How it charges
MIT-licensed and free to self-host. Enterprise is a license key on the same image, priced by deployment size; no price is published.

Strengths

  • No third party sees your traffic or your keys.
  • Spend tracked per key, team, user, tag, with a budget and model list on each key.
  • Broad provider coverage and an active open-source project.

Limits

  • You run it: a server, a Postgres database, upgrades, and someone on call while it is in the request path.
  • Its release pipeline is part of your supply chain: two PyPI releases carried credential-stealing code on 24 March 2026.

Full comparison with LiteLLM

Who it is for
Enterprises buying an AI gateway as part of a security platform, or teams self-hosting Portkey's open-source gateway.
How it charges
Production is $49 a month with 100,000 recorded logs, plus $9 per additional 100,000. The open-source gateway is MIT licensed. Enterprise is custom.

Strengths

  • Mature routing, fallbacks, guardrails and observability.
  • An MIT-licensed gateway you can host yourself.

Limits

  • Palo Alto Networks completed its acquisition on 29 May 2026; the product is now Prisma AIRS AI Gateway, so check its roadmap fits a team not buying the wider platform.
  • Logs, observability and prompt management are in the hosted app, not the open-source gateway.

Full comparison with Portkey (Prisma AIRS AI Gateway)

Using Cloudflare and a control plane together

They are not exclusive. A common shape keeps Cloudflare at the edge for what it does best (its network, caching, Workers AI) and puts budgets, attribution and audit across every provider account in a control plane behind it. Decide which layer owns retries and spend limits, so neither is applied twice.

Which one to choose

Stay on Cloudflare
if your traffic runs through Cloudflare and eventually consistent spend limits per gateway are enough.
INFRO
if you need caps that hold under concurrent load, per project, team, key and end customer, on your own provider accounts.
Vercel AI Gateway
if you deploy on Vercel and use the AI SDK.
OpenRouter
if you want every model behind one balance without provider accounts.
LiteLLM
if you must self-host.
Portkey
if you want a hosted gateway inside a security platform.

Questions

Is Cloudflare AI Gateway free?
Its core features are. Paying for model usage through its Unified Billing adds a 5% fee on each purchase; using your own provider keys carries no fee.
Do Cloudflare AI Gateway spend limits work with my own keys?
Yes, for models with known pricing. Cloudflare notes they are eventually consistent, so a burst of concurrent requests can briefly pass the limit.
Can I use Cloudflare AI Gateway and another gateway together?
Yes. Keep Cloudflare at the edge for caching and its network, and put budgets and attribution in a control plane behind it; decide which one retries.

Sources

Every statement about another company on this page comes from that company's own page, opened on the date shown. Prices and defaults change; check the source before you decide.

  1. 1.developers.cloudflare.com/ai-gateway/reference/pricing (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare AI Gateway's core features are free.
    • On the Workers Free plan, legacy logs are capped at 100,000 across all gateways.
    • On Workers Paid, legacy logs are capped at 10,000,000 per gateway.
  2. 2.developers.cloudflare.com/ai-gateway/features/unified-billing (opens in a new tab) — checked Oct 24, 2026.
    • Usage paid for through Cloudflare's Unified Billing carries a 5% fee on each purchase.
  3. 3.developers.cloudflare.com/ai-gateway/configuration/bring-your-own-keys (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare AI Gateway can store your own provider keys (BYOK) in the dashboard.
  4. 4.developers.cloudflare.com/ai-gateway/features/spend-limits (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare's spend limits count both Unified Billing and BYOK requests, for models with known pricing, and answer 429 when exceeded.
    • Cloudflare's spend limits are eventually consistent: a burst of concurrent requests can briefly pass the limit.
  5. 5.developers.cloudflare.com/ai-gateway/configuration/fallbacks (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare AI Gateway can fall back to another model or provider through its Universal endpoint when a request returns an error.
  6. 6.developers.cloudflare.com/ai-gateway/features/dynamic-routing (opens in a new tab) — checked Oct 24, 2026.
    • Dynamic routing builds request flows in a visual editor or JSON, with conditions, rate-limit and budget-limit nodes that switch to a fallback.
  7. 7.developers.cloudflare.com/ai-gateway/features/caching (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare caches only identical requests, for text and image responses, for 60 seconds to one month; semantic caching is planned, not available.
  8. 8.developers.cloudflare.com/ai-gateway/features/rate-limiting (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare's rate limits are set per gateway and applied uniformly to all its requests, returning 429 when exceeded.
  9. 9.vercel.com/docs/ai-gateway/pricing (opens in a new tab) — checked Oct 24, 2026.
    • Vercel AI Gateway charges no markup and no platform fee on tokens; you pay the provider's list price.
    • Bringing your own provider key adds no Vercel fee.
    • When a request on your own credentials fails, Vercel retries it on its own system credentials and charges that usage to your Vercel AI Gateway balance.
    • Spend on your own credentials is not counted in Vercel AI Gateway budgets, so a budget cannot cap BYOK spend.
  10. 10.ai-sdk.dev/docs/ai-sdk-core/provider-management (opens in a new tab) — checked Oct 24, 2026.
    • The Vercel AI SDK uses AI Gateway by default when you pass a model string; you can set a provider such as @ai-sdk/openai instead and call it directly.
  11. 11.openrouter.ai/pricing (opens in a new tab) — checked Oct 24, 2026.
    • OpenRouter charges a 5.5% fee each time you add balance on its Standard (pay-as-you-go) tier.
    • On its Business (pay-as-you-go) tier the fee on each balance purchase is 8%.
    • With your own provider keys (BYOK), the first $25,000 a month of list-price inference carries no OpenRouter fee.
    • OpenRouter bills inference at the provider's list price; its fee is charged when you add balance instead.
    • OpenRouter's paid tiers list 500+ models from 80+ providers.
  12. 12.openrouter.ai/docs/guides/overview/auth/byok (opens in a new tab) — checked Oct 24, 2026.
    • Past the allowance, BYOK usage is charged 5% of what the same model and provider would cost on OpenRouter.
    • By default, a BYOK request that fails or is rate limited on your key falls back to OpenRouter's shared endpoints, paid from your OpenRouter balance; a per-key "Shared capacity fallback" setting turns that off.
  13. 13.litellm.ai (opens in a new tab) — checked Oct 24, 2026.
    • The LiteLLM gateway is MIT licensed and free to self-host.
  14. 14.docs.litellm.ai/docs/enterprise (opens in a new tab) — checked Oct 24, 2026.
    • LiteLLM Enterprise is a license key on the same image, priced by deployment size and usage; no price is published.
  15. 15.docs.litellm.ai/docs/simple_proxy (opens in a new tab) — checked Oct 24, 2026.
    • LiteLLM records the cost of each request and shows spend per key, team, user and tag; each key carries a team, a budget and a model list.
    • The LiteLLM gateway is a self-hosted server started with Docker, Helm or Terraform, backed by a Postgres database you run.
  16. 16.docs.litellm.ai/blog/security-update-march-2026 (opens in a new tab) — checked Oct 24, 2026.
    • On 24 March 2026, litellm 1.82.7 and 1.82.8 on PyPI carried credential-stealing code for about 40 minutes; LiteLLM says the official Proxy Docker image was not affected and 1.83.0 is clean.
  17. 17.portkey.ai/pricing (opens in a new tab) — checked Oct 24, 2026.
    • Portkey's Production plan is $49 a month and includes 100,000 recorded logs.
    • Past the included volume, Production adds $9 for each additional 100,000.
    • Portkey's pricing page says Portkey is now Prisma AIRS AI Gateway.
  18. 18.github.com/Portkey-AI/gateway (opens in a new tab) — checked Oct 24, 2026.
    • Portkey's open-source gateway is MIT licensed; logging, observability and prompt management are available on the hosted app only.
  19. 19.paloaltonetworks.com/company/press/2026/palo-alto-networks-completes-acquisition-of-portkey-to-secure-ai-agents (opens in a new tab) — checked Oct 24, 2026.
    • Palo Alto Networks completed its acquisition of Portkey on 29 May 2026.

The team building INFRO, a BYOK-first control plane for production AI. Articles are written from the engineering work on the gateway and cite their external sources.