kitio.aiAdded Nov 5, 2026
Mirai
FreemiumOn-device LLM engine and models for iPhone, iPad and Mac
What is Mirai?
Mirai Labs builds uzu, an inference engine written in Rust that runs language models locally on Apple Silicon, plus quantized models tuned for it. It is aimed at app developers who want fast, private AI features that work without a network connection.
uzu is designed for single-request speed rather than batch throughput, with quantization planned together with the model architecture. Mirai publishes 4-bit and 8-bit versions of models such as Qwen and LFM on Hugging Face and benchmarks them against MLX and llama.cpp.
Besides the runtime there are model conversion tools, a CLI, a macOS app and an SDK, and Android support is listed as coming soon. The uzu engine is on GitHub.
Features
- uzu inference engine
- Quantized on-device models
- Model conversion tools
- CLI and macOS app
- Published benchmarks
Tags
Releases
+ Submit new release- Listed
Mirai was added to the directory.
Organization
Mirai Labs
Listed by kitio.ai · unverified owner
Pricing
- Pricing model
- Freemium
- Paid options from
- Not listed
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.
Top Mirai alternatives
View allModels & APIs
High-throughput open-source engine for serving LLMs in production
Models & APIs
C/C++ engine for running LLMs efficiently on CPUs and GPUs
Models & APIs
Apple's array framework for running and training models on Apple Silicon
Models & APIs
Fast open-source serving framework for LLMs and vision models
If you liked Mirai
The main hub for open models, datasets and AI demo apps
Freemium · $9/moModels & APIs13 views6 clicks to the websiteMade in United StatesSearch engine and vector database for AI apps and agents
Free trialModels & APIsMade in NetherlandsRun open models locally with one command, plus optional cloud models
Freemium · $20/moModels & APIs3 views4 clicks to the websiteMade in United StatesOpen-source library for similarity search over dense vectors
FreeModels & APIs3 views3 clicks to the websiteMade in United States
Pros and cons
Pros
- Runs fully offline on Apple devices
- Engine source on GitHub
- Benchmarks against MLX and llama.cpp
Cons
- Android support not yet available
- Commercial terms need a sales talk
- Limited to smaller models
Prompts & results
No prompts yet. Add your own prompt and output to help others use this tool.
Share a prompt
Reviews
Q&A
What is Mirai?
Mirai Labs builds uzu, an inference engine written in Rust that runs language models locally on Apple Silicon, plus quantized models tuned for it. It is aimed at app developers who want fast, private AI features that work without a network connection.
Does Mirai work on Android?
Not yet. uzu targets iPhone, iPad and Mac, and Android inference is listed as coming soon.
How much does Mirai cost?
Mirai is freemium.
Is there a free version of Mirai?
Yes. Mirai has a free plan, and paid plans add more usage and features.
What are the main features of Mirai?
uzu inference engine, Quantized on-device models, Model conversion tools, CLI and macOS app, Published benchmarks.
Who makes Mirai?
Mirai is made by Mirai Labs.
What are the best alternatives to Mirai?
Popular alternatives include vLLM, llama.cpp, MLX.