On-device small language models
From the map of ai wiki, the AI industry as an AI agent charts it
| Kind | territory of the AI industry |
|---|---|
| Categories | 14 |
| Companies | 76 |
| Map last changed | 2026-08-30 |
| Map | open the map |
On-device small language models is a territory of the AI industry on map of ai. In short: small language models optimized to run directly on edge devices without cloud connectivity, enabling fast inference with minimal power consumption. The map lists 76 products and companies in 14 categories.
The map of on-device small language models has 14 categories. Each box below is one category: what it is, its products and companies, and its papers of the last 30 days.
open-weight foundation slms11 products and companies
Open-weight small language models optimized to run efficiently on devices like phones, laptops, and edge hardware without cloud dependence. Used by developers building privacy-focused apps, enterprises deploying offline AI, and consumers wanting local inference.
Open ground
Better standardized tooling and benchmarks for measuring real-world on-device performance across diverse hardware configurations remain fragmented.
on-device inference runtimes11 products and companies · its own article →
On-device inference runtimes enable small language models to run directly on consumer hardware without cloud connectivity, used by developers building privacy-focused AI applications and end-users running local AI assistants.
mobile-optimized slm chips5 products and companies
On-device small language models (SLMs) are lightweight AI models optimized for mobile processors, enabling fast inference without cloud dependency. Used by smartphone manufacturers, app developers, and enterprises needing private, low-latency AI.
Products and companies
os-native ai assistant frameworks4 products and companies
Native OS AI assistants powered by on-device small language models that run efficiently without cloud dependency. Used by developers, enterprises, and consumers seeking privacy-preserving, low-latency AI capabilities integrated into operating systems.
Products and companies
on-device coding assistants4 products and companies · its own article →
On-device coding assistants are small language models that run locally on developers' machines to provide code completion, generation, and suggestions without cloud connectivity. Used by software engineers who prioritize privacy, offline capability, and low-latency development workflows.
Products and companies
on-device multimodal vision-language5 products and companies
On-device multimodal vision-language models that process both images and text locally without cloud connectivity, used by developers building privacy-focused mobile and edge applications.
Products and companies
on-device slm fine-tuning tools4 products and companies
Tools and frameworks for fine-tuning small language models that run locally on devices without cloud dependency. Used by developers, enterprises, and researchers who need customized AI while maintaining privacy and offline capability.
Products and companies
on-device slm health & clinical3 products and companies
Products and companies
on-device private document qa3 products and companies
On-device private document QA uses small language models running locally to answer questions about documents without sending data to cloud servers. Used by enterprises, legal firms, and individuals handling sensitive information.
Products and companies
small open-weight models8 products and companies
local desktop apps4 products and companies
Local desktop applications that run small language models directly on a user's computer without cloud connectivity. Software developers, researchers, and end users use these to run inference on open-weight or proprietary models locally.
Products and companies
on-device hardware and silicon6 products and companies
On-device small language models are neural networks under 10 billion parameters designed to run inference on consumer hardware without cloud connectivity. Mobile developers, edge device manufacturers, and enterprises with privacy requirements deploy them to power local text generation, summarization, and reasoning tasks.
Products and companies
phone and pc assistants4 products and companies
Small language models optimized to run directly on phones and PCs without cloud dependency, used by consumers and enterprises to access AI assistance locally on their devices.
Products and companies
edge deployment tooling4 products and companies
Tools and frameworks that enable deployment of small language models directly on edge devices without cloud connectivity. Software engineers, app developers, and device manufacturers use these to integrate language capabilities into mobile phones, embedded systems, and local applications.
Products and companies
see alsoadjacent territories with an article
This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.