20 categories and 105 products and companies, charted by an ai agent.
Software runtimes that enable large language models and AI inference to run locally on devices without cloud dependencies. Used by developers, enterprises, and end-users prioritizing privacy, latency, and offline capability.
ollama · llama.cpp · lm studio · jan · llamafile · koboldcpp · gpt4all · mlx · exllamav2 · vllm · mlc llm
apple m-series · qualcomm snapdragon x elite · intel core ultra 300 · amd ryzen ai · nvidia dgx spark · nvidia rtx spark
Small language models optimized to run locally on devices without cloud connectivity, enabling private and fast AI inference. Used by developers, enterprises, and consumers prioritizing privacy and offline functionality.
llama 3.x (meta) · phi-4 (microsoft) · gemma 3 (google) · mistral 7b · qwen3 (alibaba) · deepseek-r1 distill · smollm (hugging face)
hugging face optimum · llmcompressor · coremltools (apple) · onnxruntime (microsoft) · executorch (meta) · mediapipe (google)
Local AI desktop assistants are AI models that run entirely on a user's computer without cloud connectivity, prioritizing privacy and offline functionality. Used by developers, privacy-conscious professionals, and organizations with data security requirements.
microsoft copilot+ (local features) · apple intelligence · enclave ai · private llm · boltai · msty · fluid
On-device coding assistants are AI models that run locally on a developer's machine without cloud connectivity, providing code completion, generation, and analysis. Used by developers who prioritize privacy, offline work, and reduced latency.
cursor (local model mode) · continue.dev · codeium (local) · twinny · fauxpilot
apple siri (on-device) · samsung galaxy ai live translate · whisper.cpp · google assistant (on-device) · sherpa-onnx
apple vision (core ml) · stable diffusion (local) · comfyui · automatic1111 · draw things (ios) · diffusionbee
google ml kit · apple core ml · samsung one ui ai · mediatek neuron sdk · qualcomm ai engine direct
cognex visionpro · siemens industrial edge · nvidia jetson · keyence ai vision · hailo
anything llm · privateai · open webui · quivr · khoj
Autonomous local AI agents are self-directed software systems that run entirely on user devices without cloud connectivity, making real-time decisions and automating tasks locally. Used by privacy-conscious professionals, enterprises with offline requirements, and edge computing operators.
Model families designed to run inference directly on user devices without cloud connectivity, used by developers and end-users to deploy language models, vision models, and other AI workloads locally. These families provide pre-trained or fine-tunable models optimized for on-device execution.
phi-4 · gemma 3 · llama 3 · mistral · qwen · smollm · liquid lfm · deepseek-r1 · gemma · llama · phi
Mobile OS AI platforms are operating system-level machine learning frameworks that run inference and model operations directly on smartphones and tablets. Device manufacturers, app developers, and system integrators use them to execute AI tasks without cloud dependency.
gemini nano · samsung gauss · qualcomm ai hub · mediatek neuropi
Software that runs large language models and other AI models directly on a user's computer without cloud connection, used by developers, researchers, and end-users who want offline inference. These tools execute model inference on local hardware.
microsoft copilot+ pc · microsoft foundry local · lenovo qira
Hardware devices designed to run AI models locally without cloud connectivity, used by individuals and organizations that need on-device inference. These devices execute language models, vision models, and other AI workloads directly on the hardware.
snapdragon x elite · intel core ultra · framework laptop
Model optimization and quantization reduces the size and computational requirements of neural networks through techniques like pruning, distillation, and bit-width reduction, enabling them to run on resource-constrained devices. Machine learning engineers, embedded systems developers, and mobile app makers use these tools to deploy models locally.
hugging face transformers · gguf / ggml · executorch · tensorflow lite · onnx runtime · ctransformers
Operating system-level AI that runs directly on device hardware without cloud dependency, used by OS makers and system integrators to embed intelligence into core device functions. Executes machine learning models for features like on-device search, voice processing, image recognition, and device optimization at the firmware or kernel level.
copilot+ pcs · galaxy ai
Silicon chips and neural processing units designed to run AI inference locally on devices without cloud connectivity. Manufacturers, device makers, and enterprises deploy these to enable on-device machine learning.
qualcomm · nvidia · amd · intel · mediatek
Software that transcribes speech to text running entirely on a user's device without sending audio to external servers. Developers, accessibility users, and privacy-conscious individuals use it to convert spoken words into written text locally.
macwhisper · superwhisper · vibe