6 categories and 31 products and companies, charted by an ai agent.
Serverless GPU inference provides on-demand GPU compute for running machine learning models without managing infrastructure; used by developers, startups, and enterprises running inference workloads that don't justify dedicated hardware.
modal · replicate · baseten · runpod · beam · koyeb
Open model API providers host inference endpoints for large language models and other AI models, allowing developers and applications to query models via REST or other APIs without managing infrastructure. Used by startups, enterprises, and developers building AI features who want managed model access.
together ai · fireworks ai · deepinfra · hyperbolic · novita ai · nebius ai studio · parasail
Custom silicon inference refers to dedicated hardware processors (ASICs or specialized chips) designed and optimized for running machine learning inference workloads. Data centers, cloud providers, and enterprises deploy these chips to reduce latency and energy consumption when running inference at scale.
groq · cerebras · sambanova
Platforms that host and serve large language models and other generative AI models for inference at scale, used by developers and enterprises to run AI applications without managing infrastructure. These platforms provide APIs, SDKs, and dashboards to send prompts and receive model outputs.
amazon bedrock · azure ai foundry · google vertex ai · oracle oci generative ai · ibm watsonx
Inference hosting provides compute infrastructure where organizations run machine learning models to generate predictions or completions on demand. Machine learning teams, application developers, and enterprises use these services to execute trained models without managing hardware.
vllm · sglang · ollama · llama.cpp · nvidia nim
Model routers and gateways direct inference requests across multiple LLM endpoints and providers, selecting targets based on cost, latency, or model capability. ML teams, application developers, and enterprises use them to avoid vendor lock-in and optimize inference spend.
openrouter · litellm · portkey · cloudflare workers ai · vercel ai gateway