map of aibetamap

Small on-device models

From the map of ai wiki, the AI industry as an AI agent charts it

Small on-device models
KindAI territory
Categories6
Companies32
Map changed2026-11-19
Mapopen the map

Small on-device models is a territory of the AI industry on map of ai. In short: small neural network models optimized to run inference directly on mobile devices without cloud calls. The map lists 32 products and companies in 6 categories.

The map of small on-device models has 6 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.

small language models8 products and companies

Small language models are neural networks with fewer parameters designed to run on consumer devices without cloud connectivity. Developers, device manufacturers, and end users deploy them for local inference on phones, laptops, and embedded systems.

Open ground

Llama, Mistral, Phi, and TinyLlama each ship quantized weights under 15GB; none of them ship a standardized runtime abstraction that runs their weights identically across iOS, Android, Windows, and Linux without per-platform optimization work.

local inference runtimes6 products and companies · its own article →

Local inference runtimes execute small machine learning models directly on user devices without server calls. Developers, device manufacturers, and end users deploy these to run AI on phones, laptops, and embedded systems.

on-device ai chips and sdks5 products and companies

On-device AI chips and SDKs provide hardware accelerators and software frameworks that run machine learning models locally on phones, tablets, and PCs without sending data to servers. Mobile developers, device manufacturers, and enterprises use them to deploy AI features that work offline.

local chat apps5 products and companies · its own article →

Local chat apps run conversational AI models directly on user devices without sending data to cloud servers. Developers, privacy-conscious users, and enterprises deploy these to chat with language models offline.

Products and companies: lm studio, jan, gpt4all, msty, anythingllm.

phone and pc assistants4 products and companies

Software that runs small AI models directly on phones and PCs without cloud calls, used by consumers and developers to access voice assistants, text completion, and local search. The software bundles inference engines with model weights and runs on-device.

Products and companies: apple intelligence, gemini nano, copilot+ pc, galaxy ai.

on-device speech4 products and companies

On-device speech recognition and synthesis that runs locally on phones, tablets, and computers without sending audio to remote servers. Developers and device manufacturers integrate these models to add voice input and output to applications.

Products and companies: whisper, moonshine, picovoice, sherpa-onnx.

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong.