17 categories and 89 products and companies, charted by an ai agent.
qualcomm snapdragon · apple silicon (a/m series) · nvidia jetson orin · mediatek dimensity · google tensor g4 · sima.ai mlsoc · hailo-8 · samsung exynos npu · intel meteor lake npu · arm ethos-u
Software runtimes that execute large language models directly on user devices without cloud connectivity. Mobile developers, edge device manufacturers, and enterprises deploy these to run inference locally on phones, tablets, and edge servers.
llama.cpp · mlx (apple) · ollama · mediapipe llm inference · executorch (meta) · qualcomm ai hub · microsoft onnx runtime · lm studio · mlx · executorch · mlc llm · onnx runtime · litert
tensorflow lite · core ml (apple) · nvidia tensorrt · qualcomm snpe · openvino (intel) · android nnapi
Software and services that run conversational AI assistants directly on phones without sending audio or text to remote servers. Users are people who want voice or text interaction with AI on their device.
apple intelligence · google gemini nano · samsung galaxy ai · microsoft copilot+ pc · huawei pangu on-device
On-device computer vision processes images and video locally on edge devices without sending data to cloud servers. Mobile apps, industrial cameras, autonomous robots, and smart home devices use it for real-time object detection, pose estimation, and scene understanding.
roboflow · edge impulse · ultralytics yolo · opencv ai kit (luxonis) · alif semiconductor
Industrial edge AI runs inference on factory floors, production lines, and equipment without sending data to cloud servers. Manufacturing plants, logistics operators, and equipment makers use it to detect defects, predict maintenance, and optimize processes locally.
siemens industrial edge · aws iot greengrass · azure iot edge · adlink edge · google distributed cloud edge
whisper.cpp · apple siri on-device · picovoice · speechbrain · snips (sonos)
On-device image generation runs inference of text-to-image or image-to-image models locally on consumer hardware without cloud submission. Mobile developers, edge device manufacturers, and end users deploy these to generate images with latency under seconds and without uploading prompts to external servers.
draw things (ios) · diffusers (hugging face mobile) · invoke ai local · mochi diffusion
Autonomous robots that run AI models directly on onboard hardware without relying on cloud connectivity, used by manufacturers, logistics operators, and service providers to deploy mobile manipulation and navigation tasks. These systems perform perception, planning, and control entirely on their edge compute.
nvidia isaac · google robotic transformer (rt-2) · physical intelligence (pi) · micro-agent (arduino ai)
arduino nano 33 ble sense · stm32 cube ai · tensorflow lite for microcontrollers · sparkfun edge
Hardware and software that runs health analytics directly on wearable devices without sending data to the cloud. Users include fitness enthusiasts, patients with chronic conditions, and people monitoring vital signs who want real-time insights processed locally on their wristband, ring, or chest patch.
apple watch health ml · fitbit sense ai · withings scanwatch · oura ring ai
Small neural network models and runtimes that run inference directly on edge devices like phones, tablets, and embedded systems without cloud connectivity. Used by device makers, app developers, and enterprises to add AI features while keeping data local.
gemma · phi · qwen · llama · smollm · mistral · liquid ai
Processors and chips designed to run AI inference directly on edge devices without cloud connectivity. Device makers, embedded systems integrators, and consumer electronics manufacturers use these to add local AI capabilities to phones, IoT devices, cameras, and industrial equipment.
qualcomm · apple silicon · nvidia jetson · hailo · mediatek · google tensor
Tools and platforms for developing, optimizing, and deploying machine learning models on microcontrollers and resource-constrained edge devices with limited memory and compute. Used by embedded systems engineers, IoT developers, and hardware manufacturers building ML-enabled products.
tensorflow lite micro · neuton · stmicroelectronics · deeplite
Software and runtime systems that execute large language models directly on consumer devices without cloud connectivity. Used by smartphone manufacturers, PC makers, and app developers who need language AI features running locally.
gemini nano · galaxy ai · copilot+ pcs
Private local chat applications that run language models entirely on-device without sending data to external servers. Used by individuals and organizations requiring offline conversation capabilities with privacy guarantees.
jan · gpt4all · msty · pocketpal ai