5 categories and 26 products and companies, charted by an ai agent.
Applications that run large language models locally on user hardware without sending data to external servers. Developers, privacy-focused users, and organizations with restricted network access use these tools to run chat interfaces powered by local models.
ollama · llama.cpp · lm studio · llamafile · vllm · koboldcpp · mlx
Desktop applications that run locally on Windows, macOS, or Linux and provide chat interfaces for messaging. Used by individuals and teams who want chat clients installed on their machines rather than browser-based.
jan · gpt4all · msty · anythingllm · cherry studio · chatbox
Self-hosted web UIs let users run chat interfaces on their own machines or servers without sending data to external services. Developers, privacy-conscious users, and organizations deploy these to interact with local language models or APIs under their control.
open webui · librechat · text generation webui · lobechat · sillytavern
Mobile on-device chat apps run language models locally on phones without cloud uploads, used by people who want chat without sending messages to servers. These apps execute inference on the device's processor or neural engine.
pocketpal ai · layla · private llm · mlc chat · enclave ai
Local roleplay companions are chat applications that run on personal devices and generate conversational responses for creative roleplay scenarios. Users interact with these apps to engage in character-driven narratives and dialogue exercises.
backyard ai · koboldai lite · agnaistic