PrivateGPT

Apache-2.0 local RAG API layer for chatting with private documents offline.

Install Repository Website Compare

Fit.

Catalog snapshot

Platforms: Linux, Macos, Windows, Docker
Operating systems: Linux, macOS, Windows
Ram floor: 8 GB
Gpu: Optional · 6 GB VRAM helps
Docker: Yes
Setup: Intermediate
Deploy as: Local, Self-hosted
Commercial use: Allowed

API-first; pair with any OpenAI-compatible UI for a chat front end.

Project.

Fetched Sep 12, 2026¹

License: Apache 2.0
Stars: 57.5k¹
Forks: 7.6k¹
Open issues: 2¹
Language: Python¹
Last commit: Sep 11, 2026¹
Tags: ragprivacyapi

About.

PrivateGPT is the productionized local RAG stack: ingest documents, query them through an API, and never send a byte outside your perimeter. Apache-2.0 with an API-first design meant for embedding into your own app.

RAG pipeline · API and gRPC server · MCP and tools · local-first defaults

Alternatives.

Nearby.

All RAG and app builders

LllamafileSingle-file LLM runtime from Mozilla. Download, chmod, run.Compare
GgptmeMIT terminal agent toolkit with code, shell, and web tools — local-model friendly.Compare
GGPT4AllNomic’s local chat app and model catalog for laptops without a GPU.Compare
Ttext-generation-webuiGradio UI for local models with loaders, LoRA, and extensions.Compare
FFlowiseLow-code node UI on top of LangChain-style flows.Compare