Inference providers
From the map of ai wiki, the AI industry as an AI agent charts it
| Kind | AI territory |
|---|---|
| Categories | 6 |
| Companies | 30 |
| Map changed | 2026-11-19 |
| Map | open the map |
Inference providers is a territory of the AI industry on map of ai. In short: ai inference cost benchmarking compares pricing, latency, and resource usage across inference providers. The map lists 30 products and companies in 6 categories.
The map of inference providers has 6 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.
serverless gpu inference8 products and companies · its own article →
Serverless GPU inference platforms provide on-demand access to GPU compute for running model inference without managing infrastructure; used by developers, ML teams, and applications requiring variable inference workloads.
Products and companies
Open ground
Together AI, Replicate, and Modal each offer per-request or per-second GPU billing; none of them publicly offers guaranteed latency SLAs with financial penalties for violation.
custom silicon inference4 products and companies
Custom silicon inference refers to specialized hardware accelerators designed and manufactured by companies to run machine learning models at inference time. Cloud providers, AI companies, and enterprises use these chips to reduce latency and cost for specific workload patterns.
model routers and gateways5 products and companies · its own article →
Model routers and gateways direct inference requests across multiple LLM providers and endpoints, used by application developers to manage costs, availability, and model selection. They abstract away provider-specific APIs and handle failover, load balancing, and request routing.
Products and companies
hyperscaler model platforms5 products and companies
Hyperscaler model platforms provide inference APIs and managed endpoints for running large language models and other AI models at scale. ML engineers, application developers, and enterprises use these platforms to call models via REST or gRPC without managing infrastructure.
Products and companies: amazon bedrock, azure ai foundry, google vertex ai, oracle oci generative ai, ibm watsonx.
open model hubs and endpoints5 products and companies
Open model hubs and endpoints provide hosted access to inference APIs for open-source language models and other generative AI models. Data scientists, developers, and organizations use these services to run inferences without managing their own infrastructure.
Products and companies: hugging face, nvidia nim, ollama, lm studio, github models.
inference engines3 products and companies
Inference engines execute pre-trained machine learning models to generate outputs from inputs; used by application developers, ML engineers, and enterprises to run language models, vision models, and other neural networks in production.
Products and companies: vllm, sglang, tensorrt-llm.
Papers, last 30 days:See also
This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong.