6 categories and 32 products and companies, charted by an ai agent.
Small language models are neural networks with fewer parameters designed to run on consumer devices without cloud connectivity. Developers, device manufacturers, and end users deploy them for local inference on phones, laptops, and embedded systems.
phi · gemma · llama · qwen · smollm · mistral · liquid ai · ibm granite
Local inference runtimes execute small machine learning models directly on user devices without server calls. Developers, device manufacturers, and end users deploy these to run AI on phones, laptops, and embedded systems.
llama.cpp · ollama · mlx · onnx runtime · executorch · mlc llm
On-device AI chips and SDKs provide hardware accelerators and software frameworks that run machine learning models locally on phones, tablets, and PCs without sending data to servers. Mobile developers, device manufacturers, and enterprises use them to deploy AI features that work offline.
qualcomm ai hub · nvidia jetson · mediatek · hailo · edge impulse
Local chat apps run conversational AI models directly on user devices without sending data to cloud servers. Developers, privacy-conscious users, and enterprises deploy these to chat with language models offline.
lm studio · jan · gpt4all · msty · anythingllm
Software that runs small AI models directly on phones and PCs without cloud calls, used by consumers and developers to access voice assistants, text completion, and local search. The software bundles inference engines with model weights and runs on-device.
apple intelligence · gemini nano · copilot+ pc · galaxy ai
On-device speech recognition and synthesis that runs locally on phones, tablets, and computers without sending audio to remote servers. Developers and device manufacturers integrate these models to add voice input and output to applications.
whisper · moonshine · picovoice · sherpa-onnx