Skip to content

Search
Categories
Guides
Compare

Site footer

FossfitsOpen-source AI that fits your machine© 2026

Search Categories Alternatives Licenses Platforms Guides Compare Submit a project

Fossfits
/
LLM infrastructure
/
LiteLLM

L

LiteLLM

Proxy that translates many model APIs into one OpenAI-shaped client.

Install Repository Website Compare

Fit.

Catalog snapshot

Platforms: Linux, Macos, Windows, Docker
Operating systems: Linux, macOS, Windows
Ram floor: 2 GB
Gpu: Not needed
Docker: Yes
Setup: Intermediate
Deploy as: Local, Self-hosted
Commercial use: Allowed

MIT. The proxy is OSS. Their cloud is optional.

Project.

Fetched Sep 12, 2026¹

License: MIT
Stars: 58.6k¹
Forks: 11.4k¹
Open issues: 1699¹
Language: Python¹
Last commit: Sep 12, 2026¹
Latest release: Aug 29, 2026
Tags: gatewayproxykeys

About.

LiteLLM is a gateway. Spend logs, keys, and fallbacks. Not a model. You still pay the providers or point it at Ollama.

load balancing · budgets · logging · fallbacks

Alternatives.

OAOpenAI APIComplementary

Nearby.

All LLM infrastructure

LllamafileSingle-file LLM runtime from Mozilla. Download, chmod, run.Compare
VvLLMHigh-throughput model server for GPU inference.Compare
Lllama.cppC/C++ runtime that made local GGUF models practical.Compare
EexoLink everyday devices into one cluster and run models too big for any single machine.Compare
Sshell_gptCLI that runs an LLM as a shell command for scripts, refactors, and answers.Compare