AI Gateways & LLM Routing — Products
Updated 6/19/2026
Engine-synthesised product landscape for AI Gateways & LLM Routing, ranked by trend signal across hiring, capital, orders, and discussion axes.
Last refresh: 2026-06-18.
OpenAI-compatible Multi-Provider LLM Gateway — gateway / proxy
Trend: 🔥 hot
Opportunity: Devs want one drop-in OpenAI-compatible endpoint that abstracts provider sprawl, handles failover, and removes provider lock-in (fact 4f1adaf4: Portkey 250+ LLMs; fact 495572d5: LiteLLM Proxy 100+ providers).
This is the spine of the ai-gateways category. Portkey (7k+ stars per fact 6c959edf), LiteLLM, and Helicone are all hiring backend/platform engineers around it; community posts show indie 'AISBF' and 'AI Cost Firewall' clones validating product-market pull. The category is crowded — defensibility now shifts to ecosystem (caching, guardrails, observability) rather than the proxy itself.
Companies committing: Portkey, LiteLLM, Helicone, OpenRouter.
LLM Guardrails / Agent Security Proxy — policy-enforcement gateway
Trend: ↗ rising
Opportunity: Agent runtimes need an in-band judge to block prompt injection / data exfil / unsafe tool calls — Portkey ships 40+ pre-built deterministic & LLM-based checks (fact 6a2a6008-c864-48b8-b687-9d49125b6013); Brex open-sourced CrabTrap to fill the gap.
Strong tailwind: agentic workloads in prod are forcing gateways to grow a security plane. Helicone is hiring a 'Staff AI Agentic Security Engineer' and OpenRouter a 'Trust and Safety Lead' — every gateway is now also a policy gateway. Big-co (Brex) building in-house signals an enterprise willingness to pay.
Companies committing: Portkey, Helicone, OpenRouter.
Semantic Caching for LLM Gateway — cache layer
Trend: · weak signal
Opportunity: Cached requests are where gateways monetize latency + cost; Portkey advertises sub-1ms p50 added latency on cached calls (fact fd1ed84d-7563-4781-96e8-78ed2551fa44).
Semantic caching is moving from a Portkey feature to a standalone wedge — indie 'AI Cost Firewall' and AISBF lead with it as the headline. Hot, but commoditizing fast; whoever owns embeddings-aware cache + invalidation wins.
Companies committing: Portkey.