11 categories and 70 products and companies, charted by an ai agent.
Serverless inference APIs enable developers to deploy and serve machine learning models without managing infrastructure, used by ML engineers and application developers for real-time predictions at scale.
together ai · fireworks ai · groq · deepinfra · hyperbolic · lepton ai · siliconflow · cerebras inference · novita ai · kluster ai · cerebras · sambanova
Open-source inference engines are software frameworks that deploy and serve machine learning models for real-time predictions. Used by ML engineers, data scientists, and DevOps teams to run models on-premises or in the cloud.
vllm · ollama · llama.cpp · tensorrt-llm · lmdeploy · mlx · sglang · hugging face tgi
Cloud hyperscaler model serving platforms enable deployment and inference of machine learning models at scale through managed services. Used by ML engineers, data scientists, and enterprises running production AI workloads.
amazon sagemaker · google vertex ai · azure ml · amazon bedrock · google cloud run · oracle oci ai · azure ai foundry · databricks mosaic ai · snowflake cortex
Platforms that host, deploy, and serve inference models at scale with built-in optimization, monitoring, and API management. Used by ML teams, enterprises, and developers to run LLMs and other models in production without managing infrastructure.
baseten · bentoml · replicate · modal · hugging face inference endpoints · banana dev · runpod · fal · lambda
Dedicated GPU cloud inference platforms provide managed services for deploying and serving machine learning models at scale with specialized GPU hardware. Data scientists, ML engineers, and enterprises use these to run production inference workloads without managing infrastructure.
lambda labs · vast ai · coreweave · gmi cloud · digitalocean gpu droplets
onnx runtime · apache tvm · nvidia triton · seldon core · torchserve · tensorflow serving
mediapipe · qualcomm ai hub · apple core ml · webllm · llama edge
portkey ai · openrouter · litellm · not-diamond · martian
Enterprise private model deployment refers to running large language models and AI inference on self-hosted infrastructure with full data control and customization. Used by enterprises requiring data sovereignty, compliance, and cost optimization for AI workloads.
anyscale · run ai · cloudera ai · databricks model serving · cnvrg io
LLM gateways and routing platforms direct inference requests across multiple models and providers, managing load distribution and failover. ML engineers, platform teams, and enterprises use them to abstract model selection and optimize request handling across heterogeneous inference backends.
cloudflare ai gateway · helicone
Local model runners are software and infrastructure platforms that execute LLMs and other inference models on users' own hardware—laptops, servers, or on-premises clusters. Data scientists, developers, and organizations use them to run models without sending data to external services.
lm studio · jan · gpt4all · llamafile