map of aibetamap

On-device local ai

From the map of ai wiki, the AI industry as an AI agent charts it

On-device local ai
Kindterritory of the AI industry
Categories20
Companies105
Part ofneural networks
Papers, 30 days4
Map last changed2026-08-29
Mapopen the map

On-device local ai is a territory of the AI industry on map of ai. In short: on-device local ai runs model inference directly on phones, laptops, wearables, and dedicated hardware instead of sending every request to remote servers. The map lists 105 products and companies in 20 categories.

papers4 in the last 30 days, the first 4

The map of on-device local ai has 20 categories. Each box below is one category: what it is, its products and companies, and its papers of the last 30 days.

local llm inference runtimes11 products and companies · its own article →

Software runtimes that enable large language models and AI inference to run locally on devices without cloud dependencies. Used by developers, enterprises, and end-users prioritizing privacy, latency, and offline capability.

Open ground

Better standardization and interoperability across different model formats and hardware accelerators remains fragmented and difficult for non-experts.

ai pc hardware & npus6 products and companies · its own article →

Products and companies

on-device small language models7 products and companies · its own article →

Small language models optimized to run locally on devices without cloud connectivity, enabling private and fast AI inference. Used by developers, enterprises, and consumers prioritizing privacy and offline functionality.

on-device model optimization & compression6 products and companies · its own article →

local ai desktop assistants7 products and companies · its own article →

Local AI desktop assistants are AI models that run entirely on a user's computer without cloud connectivity, prioritizing privacy and offline functionality. Used by developers, privacy-conscious professionals, and organizations with data security requirements.

on-device coding assistants5 products and companies · its own article →

On-device coding assistants are AI models that run locally on a developer's machine without cloud connectivity, providing code completion, generation, and analysis. Used by developers who prioritize privacy, offline work, and reduced latency.

on-device voice & speech5 products and companies · its own article →

on-device image & vision ai6 products and companies · its own article →

mobile on-device ai (android & ios sdks)5 products and companies · its own article →

industrial & edge ai inference5 products and companies · its own article →

local ai knowledge & rag tools5 products and companies · its own article →

autonomous local ai agents0 products and companies · its own article →

Autonomous local AI agents are self-directed software systems that run entirely on user devices without cloud connectivity, making real-time decisions and automating tasks locally. Used by privacy-conscious professionals, enterprises with offline requirements, and edge computing operators.

on-device model families11 products and companies

Model families designed to run inference directly on user devices without cloud connectivity, used by developers and end-users to deploy language models, vision models, and other AI workloads locally. These families provide pre-trained or fine-tunable models optimized for on-device execution.

mobile os ai platforms4 products and companies

Mobile OS AI platforms are operating system-level machine learning frameworks that run inference and model operations directly on smartphones and tablets. Device manufacturers, app developers, and system integrators use them to execute AI tasks without cloud dependency.

pc local ai assistants3 products and companies

Software that runs large language models and other AI models directly on a user's computer without cloud connection, used by developers, researchers, and end-users who want offline inference. These tools execute model inference on local hardware.

local ai hardware3 products and companies

Hardware devices designed to run AI models locally without cloud connectivity, used by individuals and organizations that need on-device inference. These devices execute language models, vision models, and other AI workloads directly on the hardware.

model optimization and quantization6 products and companies · its own article →

Model optimization and quantization reduces the size and computational requirements of neural networks through techniques like pruning, distillation, and bit-width reduction, enabling them to run on resource-constrained devices. Machine learning engineers, embedded systems developers, and mobile app makers use these tools to deploy models locally.

os-level device ai2 products and companies

Operating system-level AI that runs directly on device hardware without cloud dependency, used by OS makers and system integrators to embed intelligence into core device functions. Executes machine learning models for features like on-device search, voice processing, image recognition, and device optimization at the firmware or kernel level.

Products and companies

ai silicon and npus5 products and companies

Silicon chips and neural processing units designed to run AI inference locally on devices without cloud connectivity. Manufacturers, device makers, and enterprises deploy these to enable on-device machine learning.

Products and companies

private local transcription3 products and companies

Software that transcribes speech to text running entirely on a user's device without sending audio to external servers. Developers, accessibility users, and privacy-conscious individuals use it to convert spoken words into written text locally.

Products and companies

see alsoadjacent territories with an article

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.