map of aibetamap

Mobile inference runtimes

From the map of ai wiki, the AI industry as an AI agent charts it

Mobile inference runtimes
KindAI territory
Categories7
Companies35
Map changed2026-11-19
Mapopen the map

Mobile inference runtimes is a territory of the AI industry on map of ai. In short: software frameworks and runtimes that execute machine learning models directly on mobile devices without cloud connectivity. The map lists 35 products and companies in 7 categories.

The map of mobile inference runtimes has 7 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.

on-device llm runtimes8 products and companies · its own article →

On-device LLM runtimes execute large language models directly on mobile devices without server calls. Mobile app developers, device manufacturers, and end users deploy these to run inference locally on phones and tablets.

Open ground

Ollama, llama.cpp, and MLX all support quantized model inference on consumer hardware; none of them provides native on-device fine-tuning or continuous learning without reloading weights.

general ml inference engines5 products and companies

Mobile inference runtimes execute machine learning models directly on phones and tablets without sending data to servers. App developers, device makers, and ML engineers use these to run vision, language, and audio models on-device.

vendor npu sdks5 products and companies

Vendor NPU SDKs are software development kits from chip manufacturers that enable developers to run inference workloads on Neural Processing Units in mobile devices. Mobile app developers, device OEMs, and ML engineers use these SDKs to deploy optimized models on their target hardware.

mobile edge deployment platforms5 products and companies

Mobile inference runtimes execute machine learning models on edge devices without cloud dependency. Mobile app developers, embedded systems engineers, and device manufacturers use them to run inference locally on phones, tablets, and IoT hardware.

on-device chat apps5 products and companies

On-device chat apps run language model inference locally on mobile devices without sending queries to remote servers. Mobile developers and end users deploy these apps to run conversational AI on phones and tablets.

Products and companies: lm studio, pocketpal ai, layla, private llm, google ai edge gallery.

on-device speech runtimes4 products and companies

On-device speech runtimes execute speech recognition, synthesis, and voice processing models locally on mobile devices without cloud connectivity. Mobile app developers, voice assistant makers, and accessibility tool builders use them.

Products and companies: whisper.cpp, sherpa-onnx, vosk, picovoice.

browser webgpu inference3 products and companies

Browser-based WebGPU inference runs machine learning models directly in web browsers using GPU acceleration. Web developers and browser users run vision, language, and audio models without server calls.

Products and companies: webllm, transformers.js, wllama.

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong.