map of aibetamap

Cx foundation models llm middleware

From the map of ai wiki, the AI industry as an AI agent charts it

Cx foundation models llm middleware
KindAI territory
Categories12
Companies79
Part ofneural networks
Map changed2026-08-30
Mapopen the map

Cx foundation models llm middleware is a territory of the AI industry on map of ai. In short: llm middleware provides infrastructure between applications and foundation models, handling inference serving, api routing, optimization, and deployment across cloud and edge environments. The map lists 79 products and companies in 12 categories.

The map of cx foundation models llm middleware has 12 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.

frontier llm providers12 products and companies · its own article →

Frontier LLM providers ship the most capable large language models available, used by enterprises and developers to build applications requiring state-of-the-art language understanding and generation. These providers operate the models themselves and expose them via APIs or direct access.

Open ground

OpenAI, Anthropic, and Google each release frontier models with published benchmarks; none of them publishes detailed per-token latency guarantees across all inference hardware configurations.

open-source / fine-tunable models6 products and companies

llm orchestration & chaining6 products and companies

retrieval-augmented generation (rag) platforms6 products and companies · its own article →

model routing & inference optimization6 products and companies

cx ai agent platforms11 products and companies

CX AI agent platforms are software that builds and deploys autonomous agents to handle customer interactions across channels like chat, email, and phone. Contact centers, e-commerce teams, and support operations use them to automate ticket routing, FAQ responses, and escalation decisions.

conversational voice ai6 products and companies · its own article →

Conversational voice AI systems that handle real-time spoken dialogue for customer service, support, and engagement. Contact centers, enterprises, and service providers use these to handle inbound and outbound voice interactions.

Products and companies: twilio flex ai, elevenlabs, bland ai, vapi, retell ai, deepgram.

llm evaluation & observability8 products and companies

Products and companies: langsmith, arize ai, weights & biases, helicone, braintrust, humanloop, langfuse, weights & biases weave.

prompt management & fine-tuning ops5 products and companies

Products and companies: openpipe, predibase, fiddler ai, latitude, promptlayer.

agentic workflow middleware5 products and companies

Agentic workflow middleware provides orchestration, state management, and execution layers for multi-step AI agent systems that compose LLM calls with external tools and APIs. Used by platform teams and enterprises building autonomous agents for customer service, back-office automation, and business process workflows.

Products and companies: autogen, crewai, langraph, fixie ai, letta.

llm gateways and routing4 products and companies · its own article →

LLM gateways and routing systems manage traffic, load balancing, and request distribution across multiple language models and inference endpoints. Used by enterprises, API platforms, and AI application builders to abstract model selection and optimize inference costs and latency.

Products and companies: litellm, portkey, cloudflare ai gateway, kong ai gateway.

contact center voice ai4 products and companies · its own article →

Contact center voice AI systems that process inbound and outbound calls, transcribe speech, classify intents, and route or assist agents. Contact centers, BPOs, and enterprises use these to handle customer service interactions.

Products and companies: cresta, pindrop, nice cxone, genesys cloud.

See also

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.