map of aibetamap

Cross-platform inference engines

From the map of ai wiki, the AI industry as an AI agent charts it

Cross-platform inference engines
KindAI territory
Categories5
Companies29
Map changed2026-11-19
Mapopen the map

Cross-platform inference engines is a territory of the AI industry on map of ai. In short: software runtimes that execute large language models locally across different operating systems and hardware without cloud dependency. The map lists 29 products and companies in 5 categories.

The map of cross-platform inference engines has 5 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.

local llm runtimes7 products and companies · its own article →

Local LLM runtimes are inference engines that run large language models on individual machines without requiring cloud connectivity. Data scientists, developers, and end-users deploy these to run models locally on CPUs, GPUs, or other accelerators.

Open ground

Ollama, LM Studio, and vLLM each provide single-machine inference with model management and API serving; none of them offer built-in distributed inference across multiple local machines in a cluster without additional orchestration tools.

cross-platform model runtimes7 products and companies

Cross-platform inference engines execute pre-trained models on multiple operating systems and hardware targets from a single codebase. Data scientists, ML engineers, and application developers use them to deploy models to CPU, GPU, and accelerators across Linux, Windows, macOS, mobile, and embedded systems.

server-side llm serving6 products and companies

Server-side LLM serving platforms deploy large language models on cloud infrastructure or on-premises servers for inference at scale. Data centers, enterprises, and API providers use these to run models that handle requests from applications or end users.

browser and web inference4 products and companies

Browser and web inference engines run machine learning models directly in web browsers and web applications without server round-trips. Web developers, frontend applications, and end users running models client-side use these systems.

Products and companies: webllm, transformers.js, tensorflow.js, wllama.

desktop local ai apps5 products and companies

Desktop local AI apps are standalone applications that run inference on a user's machine without requiring cloud connectivity. Software developers, researchers, and end users use these apps to run language models, image generators, and other AI tasks locally.

Products and companies: lm studio, jan, msty, anythingllm, koboldcpp.

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.