Edge inference runtimes
From the map of ai wiki, the AI industry as an AI agent charts it
| Kind | AI territory |
|---|---|
| Categories | 7 |
| Companies | 37 |
| Map changed | 2026-11-19 |
| Map | open the map |
Edge inference runtimes is a territory of the AI industry on map of ai. In short: edge inference runtimes for on-device image vision ai execute pre-trained computer vision models directly on mobile phones, tablets, and edge devices without cloud connectivity. The map lists 37 products and companies in 7 categories.
The map of edge inference runtimes has 7 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.
on-device llm runtimes8 products and companies · its own article →
On-device LLM runtimes execute large language models directly on edge devices without cloud connectivity. Mobile app developers, embedded systems engineers, and device manufacturers use these to run inference locally on phones, tablets, IoT devices, and specialized hardware.
Products and companies
Open ground
Ollama, TensorRT-LLM, and MLX support quantized model loading and batch inference on consumer hardware; none of them provides native support for federated learning updates across a fleet of edge devices without cloud coordination.
cross-platform model runtimes6 products and companies
Cross-platform model runtimes enable inference execution of machine learning models on edge devices across multiple hardware architectures and operating systems. Used by application developers, device manufacturers, and ML engineers to deploy trained models to phones, IoT devices, embedded systems, and local servers without cloud dependency.
Products and companies
browser inference4 products and companies · its own article →
Browser inference runtimes execute machine learning models directly in web browsers without server roundtrips. Web developers and applications use these to run inference on client devices.
Products and companies
hardware vendor sdks6 products and companies
Hardware vendor SDKs that enable machine learning model inference on edge devices (mobile phones, IoT devices, embedded systems). Device manufacturers, app developers, and embedded systems integrators use these to run trained models locally without cloud connectivity.
Products and companies
edge mlops platforms5 products and companies
Edge inference runtimes execute trained ML models on edge devices without cloud connectivity. ML engineers, embedded systems developers, and IoT teams use them to deploy inference workloads locally on phones, industrial equipment, and IoT hardware.
Products and companies: edge impulse, nota ai, deeplite, latent ai, octoai.
tinyml microcontroller runtimes4 products and companies
Runtimes that execute machine learning models on microcontrollers and embedded devices with limited memory and compute. Firmware engineers, embedded systems developers, and IoT manufacturers use these to run inference locally on hardware like ARM Cortex-M processors.
Products and companies: tflite micro, cmsis-nn, stm32cube.ai, emlearn.
consumer local ai apps4 products and companies
Edge inference runtimes execute machine learning models locally on consumer devices without cloud connectivity. Developers and end-users deploy these runtimes to run inference on phones, laptops, and tablets.
Products and companies: jan, gpt4all, msty, apple intelligence.
This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.