Ollama

Local model runner with a one-line CLI and a REST API.

Install Repository Website Compare

Fit.

Catalog snapshot

Platforms: Linux, Macos, Windows, Docker
Operating systems: Linux, macOS, Windows
Ram floor: 8 GB
Gpu: Optional · 8 GB VRAM helps
Docker: Yes
Setup: Beginner
Deploy as: Local
Commercial use: Allowed

8 GB RAM is enough for tiny models. 7B class wants more RAM or a GPU.

Project.

Fetched Sep 12, 2026¹

License: MIT
Stars: 180.7k¹
Forks: 17.8k¹
Open issues: 2480¹
Language: Go¹
Last commit: Sep 11, 2026¹
Latest release: Sep 1, 2026
Tags: llmgguflocal

About.

Ollama pulls GGUF-class models and serves them on localhost. It is the fastest path from zero to a local Llama. The product is a runner, not a chat UI. Pair it with Open WebUI or a coding agent.

model library · OpenAI-compatible API · GPU auto-detect · Modelfiles

Alternatives.

Nearby.

All Local AI

LllamafileSingle-file LLM runtime from Mozilla. Download, chmod, run.Compare
GgptmeMIT terminal agent toolkit with code, shell, and web tools — local-model friendly.Compare
GGPT4AllNomic’s local chat app and model catalog for laptops without a GPU.Compare
Ttext-generation-webuiGradio UI for local models with loaders, LoRA, and extensions.Compare
LLiteLLMProxy that translates many model APIs into one OpenAI-shaped client.Compare