map of aibetamap

Real-time llm inference for voice

From the map of ai wiki, the AI industry as an AI agent charts it

Real-time llm inference for voice
KindAI territory
Categories12
Companies79
Part ofgeneration
Map changed2026-08-30
Mapopen the map

Real-time llm inference for voice is a territory of the AI industry on map of ai. In short: real-time llm inference for voice processes spoken input through language models and outputs speech without noticeable delay. The map lists 79 products and companies in 12 categories.

The map of real-time llm inference for voice has 12 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.

speech-to-speech foundation models7 products and companies · its own article →

Speech-to-speech foundation models enable real-time voice conversations with AI systems, converting spoken input directly to spoken output without text intermediaries. Used by developers building voice assistants, customer service applications, and conversational AI products.

Open ground

Most solutions still struggle with natural interruption handling, emotional tone matching, and sub-100ms latency for truly human-like conversation flow.

streaming asr / speech-to-text6 products and companies

real-time neural tts7 products and companies

Real-time neural text-to-speech systems that convert text to natural-sounding voice output with minimal latency, enabling live conversational AI, customer service bots, and interactive voice applications.

Products and companies

voice agent orchestration platforms11 products and companies · its own article →

Platforms that orchestrate real-time voice interactions using large language models for low-latency inference and natural conversation flows. Used by contact centers, customer service teams, and developers building voice AI applications.

low-latency inference infrastructure11 products and companies · its own article →

Low-latency LLM inference infrastructure optimizes real-time language model responses for voice applications, enabling conversational AI with minimal delay. Used by voice assistant developers, telecom companies, and customer service platforms requiring sub-100ms response times.

enterprise voice ai agents6 products and companies · its own article →

Enterprise voice AI agents enable real-time voice interactions powered by large language models, used by contact centers, customer service teams, and sales organizations to automate phone calls and conversations at scale.

consumer voice assistants9 products and companies · its own article →

Voice-activated AI assistants that process and respond to spoken input in real-time using large language models. Used by consumers for hands-free queries, smart home control, and conversational assistance.

Products and companies: chatgpt voice mode, google gemini live, amazon alexa llm, hume ai empathic voice, ai16z eliza voice, chatgpt voice, gemini, alexa+, pi.

on-device / edge voice inference4 products and companies

Products and companies: apple on-device siri llm, qualcomm ai hub, mlc-llm, whisper.cpp.

speech-to-speech models7 products and companies

Speech-to-speech models convert spoken input directly to spoken output in real time, used by voice application developers and enterprises building conversational AI without intermediate text steps. These systems handle end-to-end voice interaction with sub-second latency.

Products and companies: openai realtime api, gemini live, moshi, ultravox, hume evi, amazon nova sonic, sesame.

Papers, last 30 days:

speech recognition and synthesis4 products and companies

Real-time LLM inference optimized for voice input and output, delivering sub-second latency for conversational AI. Used by voice application developers, contact centers, and voice assistant builders who need language model responses in live voice interactions.

Products and companies: deepgram, assemblyai, cartesia, rime.

voice agent frameworks3 products and companies · its own article →

Voice agent frameworks enable real-time inference and orchestration of large language models for spoken conversational AI. Developers and enterprises use these to build voice assistants that listen, understand, and respond with minimal latency.

Products and companies: livekit agents, pipecat, twilio.

vertical voice agents4 products and companies · its own article →

Real-time LLM inference optimized for voice applications, delivering sub-100ms latency responses in spoken conversations. Used by voice agent builders, telecom platforms, and customer service automation to enable natural back-and-forth dialogue without noticeable delays.

Products and companies: parloa, sierra, decagon, hippocratic ai.

See also

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.