5 categories and 27 products and companies, charted by an ai agent.
LLM gateways route requests across multiple language models and manage model selection based on cost, latency, or capability requirements. Teams building AI applications, API providers, and enterprises use these to abstract away model selection logic and load-balance across model providers.
openrouter · litellm · portkey · helicone · vercel ai gateway · cloudflare ai gateway · kong ai gateway
Intelligent model routing directs API requests to different LLM providers or model versions based on cost, latency, capability requirements, or load. ML teams, application developers, and enterprises use it to optimize inference spending and performance across multiple model endpoints.
martian · not diamond · unify · routellm · requesty
Platforms that intelligently route model inference requests across multiple LLM providers, model versions, or deployment endpoints based on cost, latency, capability, or availability criteria. Used by application developers and enterprises to optimize LLM consumption and avoid vendor lock-in.
amazon bedrock · azure ai foundry · vertex ai · databricks · together ai · fireworks ai
Built-in app routing directs requests across multiple LLM models within applications without external infrastructure. Developers building chat, search, or content applications use it to distribute load, test models, or switch providers.
chatgpt · perplexity · cursor · you.com · poe
Agent framework routing directs requests across multiple LLM models and inference endpoints based on capabilities, cost, and latency. ML engineers and application developers use it to distribute loads and handle model fallbacks.
langchain · llamaindex · semantic router · pydantic ai