Skip to content

Search
Categories
Guides
Compare

Site footer

FossfitsOpen-source AI that fits your machine© 2026

Search Categories Alternatives Licenses Platforms Guides Compare Submit a project

Fossfits
/
Local AI
/
llamafile

L

llamafile

Single-file LLM runtime from Mozilla. Download, chmod, run.

Install Repository Website Compare

Fit.

Catalog snapshot

Platforms: Linux, Macos, Windows
Operating systems: Linux, macOS, Windows
Ram floor: 8 GB
Gpu: Optional · 6 GB VRAM helps
Docker: No
Setup: Beginner
Deploy as: Local
Commercial use: Allowed

Apache 2.0 plus the inner llama.cpp license. CPU works.

Project.

Fetched Sep 12, 2026¹

License: Apache 2.0
Stars: 26k¹
Forks: 1.6k¹
Open issues: 190¹
Language: C++¹
Last commit: Sep 11, 2026¹
Latest release: Jun 20, 2026
Tags: single-filellama-cppportable

About.

llamafile wraps llama.cpp and a model into one executable. It is the least ops way to try a local model. Not a server farm.

one binary · OpenAI-ish server · GPU optional

Alternatives.

CChatGPTPartial
OAOpenAI APIPartial

Nearby.

GgptmeMIT terminal agent toolkit with code, shell, and web tools — local-model friendly.Compare
GGPT4AllNomic’s local chat app and model catalog for laptops without a GPU.Compare
Ttext-generation-webuiGradio UI for local models with loaders, LoRA, and extensions.Compare
LLiteLLMProxy that translates many model APIs into one OpenAI-shaped client.Compare
VvLLMHigh-throughput model server for GPU inference.Compare