AI-Toolbox vs LiteLLM
Facts only. Adjust the shortlist without leaving this page.
| Field | A AI-ToolboxA C++ framework for MDPs and POMDPs with Python bindings | L LiteLLMProxy that translates many model APIs into one OpenAI-shaped client. |
|---|---|---|
| Fit. | ||
| Platforms· | Linux | Linux, macOS, Windows, Docker |
| Docker· | No | Yes |
| Commercial | yes | yes |
| Catalog. | ||
| Category | LLM infrastructure | LLM infrastructure |
| License· | GPL-3.0 | MIT |
| Language· | C++ | Python |
| Jobs· | llm infra, artificial intelligence, c plus plus | LLM gateway, multi-provider proxy |
| Activity. | ||
| Stars· | 671 | 30k |
| Last commit· | Mar 18, 2025 | Sep 6, 2026 |
| Last release· | — | Aug 29, 2026 |
| Links | ProjectGitHubGuide | ProjectGitHubGuide |