local.ai

local.ai is a free, open-source desktop app for running AI models offline and in private. It handles model downloads, integrity checks and local inference without needing a GPU, and runs on Mac, Windows and Linux.

Built on a Rust backend, the app is small, under 10 MB on a Mac M2, and runs inference on the CPU using quantized model formats. A model manager keeps downloads in any folder you choose with a resumable, concurrent downloader, and digest checks such as BLAKE3 and SHA-256 verify files.

An inference server starts a local streaming endpoint in two clicks so other apps can use the model, and the app is described as working alongside window.ai. GPU inferencing and model search are listed as upcoming, and the source is licensed under GPLv3.