Tags
gguf.
5 listedUpdated Sep 10, 2026
- Rank 1. OllamaLocal model runner with a one-line CLI and a REST API.MIT · Linux, macOS, +2GitHub stars: 152k
- Rank 2. exoLink everyday devices into one cluster and run models too big for any single machine.Apache 2.0 · Linux, macOSGitHub stars: 47k
- Rank 3. llama.cppC/C++ runtime that made local GGUF models practical.MIT · Linux, macOS, +1GitHub stars: 87k
- Rank 4. KoboldCppOne-file llama.cpp build with a built-in chat UI aimed at offline storytelling.AGPL-3.0 · Linux, macOS, +1GitHub stars: 12k
- Rank 5. PocketPal AIRun small GGUF chat models fully offline on iOS and Android.MIT · iOS, AndroidGitHub stars: 8k