llama.cppStrong
ggml-org
Lightweight C/C++ library and CLI/server for running LLM inference locally on almost any hardware.
BREAF's verdict
Why BREAF recommends (or doesn't) llama.cpp, the full guide, and the sources it was checked against are Premium.
See PremiumDetails
Free tier
Entire tool is free and open source
Commercial use
Included in every plan
Platforms
mac, windows, linux, cli, docker
License
MIT
First released
2023-03-01
API docs
Available
Alternatives
Other tools on the same shelf — for when this isn't quite the right fit.
Hugging Face★ BREAF Pick
Hub for discovering, hosting, and running open-source AI models, datasets, and demo apps.
Ollama★ BREAF Pick
CLI tool to run open-source LLMs locally, with optional paid cloud model access.
ActivepiecesStrong
Open-source, self-hostable automation platform with an AI agent builder and 700+ integrations.
AiderStrong
Open-source terminal-based AI pair programmer that edits your local codebase and auto-commits to git.