Skip to content

Alternatives

LiteLLM alternatives: hosted vs self-hosted proxy

If you want LiteLLM without running it, there is no LiteLLM-run hosted service listed on its site or docs: the managed alternatives are INFRO, Portkey, Cloudflare AI Gateway and Vercel AI Gateway, and OpenRouter if you would rather not hold provider accounts. If you want to keep self-hosting, Bifrost and Portkey's open-source gateway are the closest swaps; either way, the March 2026 incident is a reason to tighten your supply chain, not only to change products.

By INFRO Editorial

Last updated

Last checked

On this page
  1. Is there a hosted LiteLLM?
  2. What running LiteLLM yourself involves
  3. The March 2026 incident, and the lesson for any gateway
  4. The alternatives, side by side
  5. When to stay on LiteLLM
  6. Which one to choose
  7. Moving from LiteLLM to INFRO
  8. Questions
  9. Sources

Is there a hosted LiteLLM?

Not one LiteLLM runs for you, as far as its own pages show. Its site describes the gateway as "Open source. Self-hosted.", deployed into your own cloud, and its Enterprise tier is a license key on the same image you run. Third-party templates (Railway, Render and similar) start a LiteLLM container on your account; you still own its upgrades and its database.

So "hosted LiteLLM" means one of two things in practice: LiteLLM on infrastructure you rent, which is still self-hosting, or a managed gateway that does the same job, which is what the rest of this page compares.

What running LiteLLM yourself involves

You take onWhy it matters
A server and a Postgres databaseBudgets, keys and spend live there; if Postgres is slow, so is every request
Upgrades and release verificationPin versions by hash; the pipeline that builds what you install is part of your attack surface
On-callThe gateway is in front of every model call; when it is down, your AI features are down
SSO past five usersLiteLLM's SSO is free for up to 5 users; more needs an Enterprise license
ScalingEach instance is yours to size, monitor and roll

None of this is a reason to avoid LiteLLM. It is the price of keeping keys and prompts inside your network, and many teams pay it gladly.

The March 2026 incident, and the lesson for any gateway

On 24 March 2026, two LiteLLM releases on PyPI (1.82.7 and 1.82.8) carried credential-stealing code for about 40 minutes. LiteLLM traced the compromise to a dependency in its CI pipeline, removed the packages, and released a clean 1.83.0; it says customers running the official LiteLLM Proxy Docker image were not affected.

The lesson applies to every product here, hosted or not, because a gateway holds a key for every provider account you have:

  • Install by hash, not by version range, and prefer images with pinned dependencies.
  • Pin CI actions to commits, not tags.
  • Give the gateway inference-only keys, one per provider account, never an admin key.
  • Rehearse rotating every key it holds, and time it.
  • Ask a hosted vendor how it builds, signs and deploys what it runs.

The alternatives, side by side

Each option is described from its own pricing page, docs or repository, checked on the date at the top. INFRO is listed first because this is INFRO's site; its limits are listed as plainly as everyone else's.

Who it is for
Teams that want LiteLLM's job (one API, budgets, failover on their own keys) without running the service.
How it charges
A flat plan of $35–$599 a month, chosen by request volume (100K–10M requests a month), never by spend. 0% markup on model spend: your providers bill you directly.

Strengths

  • Every request runs on a provider account you own; INFRO holds none, so nothing falls back onto someone else's contract.
  • Budgets refuse a request before the provider is called, per organization, project, member and key, and (from the Team plan) per end customer.
  • Each response names the provider, connection and model that served it, with an estimated provider cost.

Limits

  • No shared capacity: when every connection you own fails, the request fails with an error that says why.
  • Hosted only on its plans; a self-hosted deployment needs an enterprise agreement.
  • No prompt management or output evaluation.
Who it is for
Enterprises buying an AI gateway as part of a security platform, or teams self-hosting Portkey's open-source gateway.
How it charges
Production is $49 a month with 100,000 recorded logs, plus $9 per additional 100,000. The open-source gateway is MIT licensed. Enterprise is custom.

Strengths

  • Mature routing, fallbacks, guardrails and observability.
  • An MIT-licensed gateway you can host yourself.

Limits

  • Palo Alto Networks completed its acquisition on 29 May 2026; the product is now Prisma AIRS AI Gateway, so check its roadmap fits a team not buying the wider platform.
  • Logs, observability and prompt management are in the hosted app, not the open-source gateway.

Full comparison with Portkey (Prisma AIRS AI Gateway)

Who it is for
Teams that want a self-hosted gateway with budgets and an MCP gateway in one binary.
How it charges
Apache 2.0 and free to self-host.

Strengths

  • Written in Go, started with npx, Docker or as a Go library.
  • Failover between providers, and virtual keys with team and customer budgets.

Limits

  • You run and patch it.
  • Its published overhead figures are its own benchmarks, and two of them disagree.
Who it is for
Applications already on Cloudflare that want logging, caching and spend limits close to their Workers.
How it charges
Core features are free. Your own keys carry no fee; paying through Cloudflare's Unified Billing adds 5% on each purchase.

Strengths

  • Free core gateway with caching, logging, rate limits and model fallbacks.
  • Spend limits that count your own-key traffic for models with known pricing.

Limits

  • Spend limits are eventually consistent: a burst of concurrent requests can briefly pass them.
  • Caching is exact-match only, for text and image responses.

Full comparison with Cloudflare AI Gateway

Who it is for
Teams building on Vercel and the AI SDK who want the gateway in the same dashboard.
How it charges
No markup and no platform fee on tokens, including with your own keys. Some capabilities are paid add-ons.

Strengths

  • List-price tokens with no gateway fee.
  • The AI SDK uses it by default when you pass a model string.

Limits

  • When a request on your own credentials fails, Vercel retries it on its own system credentials and charges your AI Gateway balance.
  • Budgets do not count spend on your own keys, so they cannot cap BYOK traffic.

Full comparison with Vercel AI Gateway

Who it is for
Teams that want hundreds of models behind one key and one balance, without an account at each provider.
How it charges
5.5% on each balance purchase (8% on Business). With your own keys: no fee on the first $25,000 a month of list-price usage, then 5%.

Strengths

  • 500+ models, 80+ providers behind one API key.
  • Inference at each provider's list price, with routing and fallbacks between providers.

Limits

  • The fee grows with your spend, and your negotiated rates do not apply to its balance.
  • With your own keys, a failed request falls back to OpenRouter's shared capacity by default.

Full comparison with OpenRouter

When to stay on LiteLLM

Stay when prompts and keys must not leave your network, you already run it well, and you have the people to keep it patched. Pin a verified version by hash, prefer the pinned Docker image, isolate the proxy with only the secrets it needs, and keep up with its security releases. For comparison, INFRO vs LiteLLM sets out what each costs you to run.

Who it is for
Teams that want no vendor in the request path and have engineers to run a production service.
How it charges
MIT-licensed and free to self-host. Enterprise is a license key on the same image, priced by deployment size; no price is published.

Strengths

  • No third party sees your traffic or your keys.
  • Spend tracked per key, team, user, tag, with a budget and model list on each key.
  • Broad provider coverage and an active open-source project.

Limits

  • You run it: a server, a Postgres database, upgrades, and someone on call while it is in the request path.
  • Its release pipeline is part of your supply chain: two PyPI releases carried credential-stealing code on 24 March 2026.

Full comparison with LiteLLM

Which one to choose

LiteLLM, self-hosted
if prompts and keys must stay in your network and you can run a service in the request path.
Bifrost or Portkey's open-source gateway
if you want to keep self-hosting but change the codebase you depend on.
INFRO
if you want the same job hosted, on your own provider accounts, with budgets that refuse before the call and a flat price.
Portkey
if you want a hosted gateway inside a security platform.
Cloudflare or Vercel AI Gateway
if your application already runs there and their budget rules for your own keys fit.
OpenRouter
if you would rather not hold provider accounts at all and accept a fee on spend.

Questions

Does LiteLLM have a hosted version?
Its own site describes it as open source and self-hosted, deployed into your cloud, and no LiteLLM-run hosted service was listed when we checked. Managed gateways such as INFRO, Portkey, Cloudflare and Vercel do the same job without you running it.
Is LiteLLM safe to use after the supply-chain attack?
LiteLLM removed the two affected PyPI releases, moved to a new pipeline and says its official Proxy Docker image was not affected. Pin verified versions by hash and isolate the proxy, as you should for any gateway that holds provider keys.
What is the closest alternative to the LiteLLM proxy?
To keep self-hosting: Bifrost or Portkey's open-source gateway. To stop running it: a hosted BYOK gateway such as INFRO, which keeps every request on your own provider accounts.

Sources

Every statement about another company on this page comes from that company's own page, opened on the date shown. Prices and defaults change; check the source before you decide.

  1. 1.litellm.ai (opens in a new tab) — checked Oct 24, 2026.
    • LiteLLM describes itself as open source and self-hosted, deployed into your own cloud; no LiteLLM-run hosted service was listed on its site or docs.
    • The LiteLLM gateway is MIT licensed and free to self-host.
  2. 2.docs.litellm.ai/docs/simple_proxy (opens in a new tab) — checked Oct 24, 2026.
    • The LiteLLM gateway is a self-hosted server started with Docker, Helm or Terraform, backed by a Postgres database you run.
    • LiteLLM records the cost of each request and shows spend per key, team, user and tag; each key carries a team, a budget and a model list.
  3. 3.docs.litellm.ai/blog/security-update-march-2026 (opens in a new tab) — checked Oct 24, 2026.
    • On 24 March 2026, litellm 1.82.7 and 1.82.8 on PyPI carried credential-stealing code for about 40 minutes; LiteLLM says the official Proxy Docker image was not affected and 1.83.0 is clean.
  4. 4.docs.litellm.ai/docs/enterprise (opens in a new tab) — checked Oct 24, 2026.
    • LiteLLM's SSO is free for up to 5 users; more needs an Enterprise license.
    • LiteLLM Enterprise is a license key on the same image, priced by deployment size and usage; no price is published.
  5. 5.portkey.ai/pricing (opens in a new tab) — checked Oct 24, 2026.
    • Portkey's Production plan is $49 a month and includes 100,000 recorded logs.
    • Past the included volume, Production adds $9 for each additional 100,000.
    • Portkey's pricing page says Portkey is now Prisma AIRS AI Gateway.
  6. 6.github.com/Portkey-AI/gateway (opens in a new tab) — checked Oct 24, 2026.
    • Portkey's open-source gateway is MIT licensed; logging, observability and prompt management are available on the hosted app only.
  7. 7.paloaltonetworks.com/company/press/2026/palo-alto-networks-completes-acquisition-of-portkey-to-secure-ai-agents (opens in a new tab) — checked Oct 24, 2026.
    • Palo Alto Networks completed its acquisition of Portkey on 29 May 2026.
  8. 8.github.com/maximhq/bifrost (opens in a new tab) — checked Oct 24, 2026.
    • Bifrost is an Apache 2.0 open-source gateway written in Go, started with npx, Docker or its Go SDK.
    • Bifrost lists failover between providers and models, and virtual keys with team and customer budgets, as well as an MCP gateway.
  9. 9.developers.cloudflare.com/ai-gateway/reference/pricing (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare AI Gateway's core features are free.
  10. 10.developers.cloudflare.com/ai-gateway/configuration/bring-your-own-keys (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare AI Gateway can store your own provider keys (BYOK) in the dashboard.
  11. 11.developers.cloudflare.com/ai-gateway/features/unified-billing (opens in a new tab) — checked Oct 24, 2026.
    • Usage paid for through Cloudflare's Unified Billing carries a 5% fee on each purchase.
  12. 12.developers.cloudflare.com/ai-gateway/features/spend-limits (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare's spend limits count both Unified Billing and BYOK requests, for models with known pricing, and answer 429 when exceeded.
    • Cloudflare's spend limits are eventually consistent: a burst of concurrent requests can briefly pass the limit.
  13. 13.developers.cloudflare.com/ai-gateway/configuration/fallbacks (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare AI Gateway can fall back to another model or provider through its Universal endpoint when a request returns an error.
  14. 14.developers.cloudflare.com/ai-gateway/features/caching (opens in a new tab) — checked Oct 24, 2026.
    • Cloudflare caches only identical requests, for text and image responses, for 60 seconds to one month; semantic caching is planned, not available.
  15. 15.vercel.com/docs/ai-gateway/pricing (opens in a new tab) — checked Oct 24, 2026.
    • Vercel AI Gateway charges no markup and no platform fee on tokens; you pay the provider's list price.
    • Bringing your own provider key adds no Vercel fee.
    • When a request on your own credentials fails, Vercel retries it on its own system credentials and charges that usage to your Vercel AI Gateway balance.
    • Spend on your own credentials is not counted in Vercel AI Gateway budgets, so a budget cannot cap BYOK spend.
  16. 16.ai-sdk.dev/docs/ai-sdk-core/provider-management (opens in a new tab) — checked Oct 24, 2026.
    • The Vercel AI SDK uses AI Gateway by default when you pass a model string; you can set a provider such as @ai-sdk/openai instead and call it directly.
  17. 17.openrouter.ai/pricing (opens in a new tab) — checked Oct 24, 2026.
    • OpenRouter charges a 5.5% fee each time you add balance on its Standard (pay-as-you-go) tier.
    • On its Business (pay-as-you-go) tier the fee on each balance purchase is 8%.
    • With your own provider keys (BYOK), the first $25,000 a month of list-price inference carries no OpenRouter fee.
    • OpenRouter bills inference at the provider's list price; its fee is charged when you add balance instead.
    • OpenRouter's paid tiers list 500+ models from 80+ providers.
  18. 18.openrouter.ai/docs/guides/overview/auth/byok (opens in a new tab) — checked Oct 24, 2026.
    • Past the allowance, BYOK usage is charged 5% of what the same model and provider would cost on OpenRouter.
    • By default, a BYOK request that fails or is rate limited on your key falls back to OpenRouter's shared endpoints, paid from your OpenRouter balance; a per-key "Shared capacity fallback" setting turns that off.

The team building INFRO, a BYOK-first control plane for production AI. Articles are written from the engineering work on the gateway and cite their external sources.