12 categories and 72 products and companies, charted by an ai agent.
Quantization toolkits reduce model size and computational requirements by lowering numerical precision, enabling efficient deployment on edge devices. ML engineers and embedded systems developers use them to optimize inference speed and memory usage.
llm.int8 / bitsandbytes · gptq · awq · gguf / llama.cpp · pytorch ao · intel neural compressor · sony mct · tensorflow model optimization toolkit · qualcomm aimet · apple coreml tools
Knowledge distillation frameworks enable compression of large neural networks into smaller, efficient models suitable for edge devices and mobile deployment. Used by ML engineers, mobile app developers, and edge AI practitioners to reduce model size and inference latency while maintaining accuracy.
hugging face optimum · microsoft olive · neural magic sparseml · pytorch distiller · tinybert
neural magic deepsparse · cerebras weight streaming · qualcomm aimet pruning · pytorch structured pruning · apple magnitude pruning
On-device LLM runtimes enable large language models to run locally on devices through optimization and compression techniques, eliminating cloud dependency. Used by developers, enterprises, and device manufacturers seeking privacy-preserving, low-latency AI inference.
llama.cpp · mlc llm · ollama · google mediapipe llm inference · microsoft onnx runtime · apple core ml · lm studio · jan ai · executorch · onnx runtime · tensorflow lite · mlx · openvino
tflite · tvm apache · qualcomm qnn sdk · nvidia tensorrt · arm ethos-u npu sdk · mediatek neuron sdk
once-for-all (mit han lab) · efficientnet / efficientdet · mobilenet series · microsoft automl for neural architecture
microsoft phi-3 / phi-4 · google gemma 2 / gemma 3 · meta llama 3.2 (1b/3b) · apple openelm · mistral 7b · qwen2.5
Platforms that optimize machine learning models for efficient on-device deployment through compression, quantization, and pruning techniques. Used by mobile developers, embedded systems engineers, and ML practitioners who need faster inference with lower resource consumption.
deci ai (now nvidia) · neural magic · notdiamond · pruna ai · nvidia tensorrt model optimizer · deci
Edge vision AI compression optimizes deep learning models to run efficiently on resource-constrained devices like smartphones, IoT cameras, and embedded systems. Used by mobile app developers, robotics companies, and edge device manufacturers to deploy real-time computer vision without cloud dependency.
hailo · kneron · alif semiconductor · lattice sensai
On-device model optimization compression reduces the size and computational requirements of language models so they run on edge devices like phones and embedded systems. Mobile app developers, IoT manufacturers, and enterprises needing offline inference use these tools.
microsoft phi · google gemma · meta llama · qwen · mistral ai · liquid ai
On-device model optimization compression reduces neural network size and computational requirements for inference on edge devices and NPUs through techniques like quantization, pruning, and knowledge distillation. Mobile app developers, embedded systems engineers, and edge AI platform providers use these tools to deploy models on phones, IoT devices, and specialized processors.
qualcomm · apple · mediatek · edge impulse
On-device model optimization compression reduces neural network size and computational requirements for execution on edge devices through techniques like quantization, pruning, and knowledge distillation. Mobile app developers, embedded systems engineers, and IoT manufacturers use these tools to deploy models locally without cloud dependencies.
gpt4all · msty · apple intelligence