kitio.aiAdded Oct 28, 2026
GGML
FreeLightweight tensor library for running large models locally
What is GGML?
ggml is a C tensor library for machine learning that lets large models run with good speed on ordinary hardware. It underpins popular local inference projects including llama.cpp and whisper.cpp, and is aimed at developers who build on-device AI.
The library supports integer quantisation, broad hardware targets and has no third-party dependencies. It performs zero memory allocations at runtime and aims to keep the codebase small and simple.
The code is open under the MIT licence, with development in the ggml-org organisation on GitHub. The company was founded in 2023 by Georgi Gerganov, and the site states it was acquired by Hugging Face in 2026.
Features
- Tensor library in C
- Integer quantisation
- Broad hardware support
- No third-party dependencies
- Used by llama.cpp and whisper.cpp
Tags
Releases
+ Submit new release- Listed
GGML was added to the directory.
Organization
ggml.ai
Listed by kitio.ai · unverified owner
Pricing
- Pricing model
- Free
- Paid options from
- 100% free
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.
Top GGML alternatives
View allModels & APIs
The main hub for open models, datasets and AI demo apps
Models & APIs
Run open models locally with one command, plus optional cloud models
Models & APIs
Open-source library for similarity search over dense vectors
If you liked GGML
High-throughput open-source engine for serving LLMs in production
FreeModels & APIs1 viewsMade in United StatesRun and deploy open-source AI models through a simple API
PaidModels & APIsMade in United StatesFast inference and fine-tuning platform for open models
PaidModels & APIsMade in United StatesOpen-source deep learning library that runs on JAX, PyTorch and TF
FreeModels & APIsMade in United States
Pros and cons
Pros
- Free and MIT licensed
- Runs on commodity hardware
- Minimal and dependency free
Cons
- Low-level library, not an end-user app
- Requires programming knowledge
- Commercial extensions may arrive later
Prompts & results
No prompts yet. Add your own prompt and output to help others use this tool.
Share a prompt
Reviews
Q&A
What is GGML?
ggml is a C tensor library for machine learning that lets large models run with good speed on ordinary hardware. It underpins popular local inference projects including llama.cpp and whisper.cpp, and is aimed at developers who build on-device AI.
Which projects use ggml?
The site names llama.cpp and whisper.cpp as projects built on it.
What licence does ggml use?
It is released under the MIT licence, and development happens in the open on GitHub.
How much does GGML cost?
GGML is 100% free.
Is there a free version of GGML?
Yes. GGML is completely free to use.
What are the main features of GGML?
Tensor library in C, Integer quantisation, Broad hardware support, No third-party dependencies, Used by llama.cpp and whisper.cpp.
Who makes GGML?
GGML is made by ggml.ai.
What are the best alternatives to GGML?
Popular alternatives include Hugging Face, Ollama, Faiss.