20 categories and 76 products and companies, charted by an ai agent.
APIs providing access to frontier AI models for inference and generation tasks. Used by developers, enterprises, and applications requiring state-of-the-art language, vision, or multimodal capabilities.
openai api · anthropic claude api · google gemini api · mistral la plateforme · xai grok api · cohere api · meta llama api · openai · anthropic · google deepmind · mistral ai · xai · cohere · meta ai · amazon bedrock · azure openai service · deepseek · moonshot ai
Platforms that host and serve open-source language models through APIs for inference without requiring users to manage infrastructure. Used by developers, researchers, and businesses building AI applications.
together ai · fireworks ai · hugging face inference api · deepinfra · replicate · clarifai · perplexity api · hugging face inference providers
Ultra-low latency inference delivers AI model predictions with minimal delay, typically sub-100ms responses. Used by financial trading systems, autonomous vehicles, real-time gaming, and interactive applications requiring immediate AI decisions.
groq · cerebras inference · sambanova cloud · gme cloud
openrouter · aws bedrock · azure ai foundry · google vertex ai · portkey · not diamond · oracle oci generative ai · ibm watsonx · litellm · cloudflare ai gateway · vercel ai gateway
modal · replicate · banana dev · beam cloud · coreweave inference
fal ai · stability ai api · elevenlabs api · deepgram · lumaai api · ideogram api
ollama · llama cpp server · jan ai
helicone · langsmith · braintrust · patronus ai
Platforms that aggregate inference APIs from multiple model providers and automatically route requests to the cheapest available option in real-time. Used by developers, startups, and enterprises seeking to minimize LLM inference costs without vendor lock-in.
Open-weight model hosting provides inference APIs for publicly released large language and multimodal models without proprietary restrictions. Developers, researchers, and companies use these services to run models like Llama, Mistral, and Phi without building their own infrastructure.
hugging face inference · siliconflow · novita ai
Hardware-accelerated inference runs ML models on specialized processors like GPUs, TPUs, and custom accelerators to reduce latency and cost. Used by cloud providers, ML platforms, and enterprises deploying models at scale.
sambanova systems · etched
Serverless GPU compute provides on-demand GPU resources for running inference without managing infrastructure; developers and enterprises use it to run model inference at scale without provisioning servers.
baseten · coreweave · lambda labs · vast.ai
Inference routing and aggregation directs model inference requests across multiple providers, models, or endpoints to optimize for cost, latency, or availability. ML teams, application developers, and enterprises use it to distribute inference workloads without vendor lock-in.
unify
LLM observability and evaluation tools that monitor model inference performance, track metrics like latency and accuracy, and assess model outputs in production. Used by ML engineers, platform teams, and enterprises running large language models to understand system behavior and validate model quality.
arize ai · weights and biases
Specialized inference chips are hardware accelerators (TPUs, NPUs, custom silicon) designed to run machine learning models efficiently at inference time. They are used by cloud providers, model API services, and enterprises to reduce latency and cost when serving predictions.
cerebras · sambanova
Inference engines and serving deliver machine learning models to applications through APIs and runtime systems. Data teams, application developers, and ML engineers use these to run inference at scale without managing underlying infrastructure.
vllm · sglang · anyscale
Model APIs Inference provides hosted endpoints for running machine learning models with pay-per-call pricing. Developers, startups, and enterprises use these APIs to generate predictions without managing infrastructure.
Inference API model-as-a-service provides on-demand access to trained models via REST or gRPC endpoints, allowing developers and enterprises to run inference without managing infrastructure. Users include AI application builders, businesses automating tasks, and research teams that need compute-on-demand for ML workloads.
Managed inference cloud hyperscalers provide API endpoints where customers send prompts and receive model outputs without managing infrastructure. Used by developers, enterprises, and applications that need to run language models, vision models, or other AI models on demand.