Inference price arbitrage brokers
From the map of ai wiki, the AI industry as an AI agent charts it
| Kind | AI territory |
|---|---|
| Categories | 10 |
| Companies | 53 |
| Map changed | 2026-08-29 |
| Map | open the map |
Inference price arbitrage brokers is a territory of the AI industry on map of ai. In short: platforms that aggregate inference apis from multiple model providers and automatically route requests to the cheapest available option in real-time. The map lists 53 products and companies in 10 categories.
The map of inference price arbitrage brokers has 10 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.
llm api routing & arbitrage brokers9 products and companies
Products and companies
serverless inference marketplaces10 products and companies
Platforms that aggregate and route inference requests across multiple AI model providers to optimize for cost, latency, and availability. Used by developers, startups, and enterprises seeking to minimize inference spending through dynamic provider selection.
Products and companies
Open ground
No single platform yet seamlessly handles multi-modal inference arbitrage with real-time cost-accuracy tradeoffs across proprietary, open-source, and specialized model providers.
inference cost monitoring & finops5 products and companies
Products and companies
adaptive model routing (cost-quality tradeoff)5 products and companies
Products and companies
gpu spot & reserved capacity brokers6 products and companies
Products and companies
model benchmark & price comparison tools4 products and companies
Products and companies: artificialanalysis, llm pricing, openllm leaderboard, vantage.
prompt caching & token compression brokers4 products and companies
Products and companies: anthropic prompt caching, gptcache, momento ai, llmlingua.
gpu compute marketplaces4 products and companies
Platforms that identify and execute trades across GPU compute providers to capture price differences between markets. ML engineers and inference applications use these to reduce compute costs by routing workloads to cheaper providers in real time.
Products and companies: runpod, shadeform, prime intellect, lambda.
decentralized inference networks4 products and companies
Decentralized inference networks route and execute machine learning inference requests across distributed node operators, pricing based on real-time capacity and demand. Teams building AI applications and inference aggregators use these networks to access compute without centralized provider lock-in.
Products and companies: bittensor, akash network, io.net, gensyn.
cost optimization for ai apps2 products and companies
Inference price arbitrage brokers route API requests across multiple LLM and AI inference providers to minimize per-token costs. ML teams and application builders use these to automatically select the cheapest provider that meets their latency and quality requirements.
See also
This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.