11 categories and 68 products and companies, charted by an ai agent.
Cloud-based inference APIs provided by major hyperscalers that handle model serving, scaling, and inference workloads without requiring infrastructure management. Used by enterprises, developers, and AI teams needing production-grade model deployment.
aws sagemaker inference · google vertex ai · azure ai inference · oracle cloud ai services · ibm watsonx.ai · nvidia dgx cloud · alibaba cloud pai
Platforms enabling independent deployment and management of AI model inference without vendor lock-in, used by developers, enterprises, and ML teams seeking flexibility and cost control.
groq · together ai · fireworks ai · cerebras inference · deepinfra · lepton ai · nebius ai · gmi cloud · baseten · hyperbolic · hugging face inference providers
Cloud platforms offering managed API access to frontier AI models (GPT, Claude, Gemini, etc.) for developers and enterprises. Used by application builders, enterprises, and startups avoiding infrastructure management.
openai api · anthropic api · google gemini api · meta llama api · mistral ai api · xai grok api · cohere api
Serverless GPU clouds provide on-demand GPU compute without infrastructure management, used by ML engineers, data scientists, and developers for inference workloads at scale. Users pay per compute consumed rather than maintaining dedicated hardware.
runpod · lambda labs · coreweave · vast ai · spheron · hugging face inference endpoints · lambda · nebius · crusoe
Managed services that handle embedding generation and vector search/retrieval at scale, provided by cloud hyperscalers. Used by enterprises building AI applications requiring semantic search and RAG capabilities.
openai embeddings · cohere embed · voyage ai · jina embeddings · nomic embed
Managed cloud services that enable multimodal AI inference (text, image, video, audio) without infrastructure management. Used by developers, enterprises, and startups building AI applications.
openai vision api · google gemini vision · anthropic claude vision · replicate · fal ai · stability ai api
Inference routing and gateway layers are platforms that intelligently direct AI inference requests across multiple cloud providers and models, optimizing for cost, latency, and availability. Used by enterprises and AI applications requiring flexible, scalable model serving without vendor lock-in.
openrouter · portkey ai · martian · not diamond · brainlid langchain router
Managed inference cloud services that deploy and run AI models at scale, typically within specific geographic regions or sovereign boundaries to meet data residency and compliance requirements. Used by enterprises, governments, and developers needing localized AI inference with regulatory guarantees.
scaleway generative apis · mistral la plateforme · aleph alpha · naver clova · tencent hunyuan api
Managed inference cloud services operated by hyperscale cloud providers that run inference workloads on their infrastructure. Used by developers and enterprises running LLM and ML model inference at scale without managing underlying compute.
amazon bedrock · azure ai foundry · oracle oci generative ai · alibaba cloud model studio · tencent cloud · volcano engine
Specialized AI chip inference refers to inference execution on custom silicon designed for neural networks, offered as managed services by cloud providers. ML engineers and applications use these services to run model inference at scale on hardware like TPUs, Trainium, Gaudi, or Cerebras chips.
cerebras · sambanova
Serverless GPU inference platforms provided by hyperscalers that allow users to deploy and run machine learning models without managing underlying infrastructure. Data scientists, ML engineers, and application developers use these services to serve models at scale with pay-per-use pricing.
modal · anyscale · cloudflare workers ai · databricks mosaic ai · snowflake cortex