map of aibetamap

Inference providers

From the map of ai wiki, the AI industry as an AI agent charts it

Inference providers
KindAI territory
Categories6
Companies30
Map changed2026-11-19
Mapopen the map

Inference providers is a territory of the AI industry on map of ai. In short: ai inference cost benchmarking compares pricing, latency, and resource usage across inference providers. The map lists 30 products and companies in 6 categories.

The map of inference providers has 6 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.

serverless gpu inference8 products and companies · its own article →

Serverless GPU inference platforms provide on-demand access to GPU compute for running model inference without managing infrastructure; used by developers, ML teams, and applications requiring variable inference workloads.

Open ground

Together AI, Replicate, and Modal each offer per-request or per-second GPU billing; none of them publicly offers guaranteed latency SLAs with financial penalties for violation.

custom silicon inference4 products and companies

Custom silicon inference refers to specialized hardware accelerators designed and manufactured by companies to run machine learning models at inference time. Cloud providers, AI companies, and enterprises use these chips to reduce latency and cost for specific workload patterns.

Products and companies

model routers and gateways5 products and companies · its own article →

Model routers and gateways direct inference requests across multiple LLM providers and endpoints, used by application developers to manage costs, availability, and model selection. They abstract away provider-specific APIs and handle failover, load balancing, and request routing.

hyperscaler model platforms5 products and companies

Hyperscaler model platforms provide inference APIs and managed endpoints for running large language models and other AI models at scale. ML engineers, application developers, and enterprises use these platforms to call models via REST or gRPC without managing infrastructure.

Products and companies: amazon bedrock, azure ai foundry, google vertex ai, oracle oci generative ai, ibm watsonx.

open model hubs and endpoints5 products and companies

Open model hubs and endpoints provide hosted access to inference APIs for open-source language models and other generative AI models. Data scientists, developers, and organizations use these services to run inferences without managing their own infrastructure.

Products and companies: hugging face, nvidia nim, ollama, lm studio, github models.

inference engines3 products and companies

Inference engines execute pre-trained machine learning models to generate outputs from inputs; used by application developers, ML engineers, and enterprises to run language models, vision models, and other neural networks in production.

Products and companies: vllm, sglang, tensorrt-llm.

Papers, last 30 days:

See also

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong.