L
LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
Project.
Catalog snapshot
- License
- Apache 2.0
- Platforms
- Linux
- Docker
- No
- Commercial use
- Allowed
- Stars
- 3.9k
- Language
- Python
- Last commit
Repository health snapshot: 303 forks and 52 open issues at review time. Platform support is inferred conservatively from repository topics.
About.
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling. Fossfits includes LitServe as an actively maintained coding agents option: its public repository was updated on 2026-09-10, uses the APACHE-2.0 license, and had 3,938 stars when reviewed. Check its documentation and release notes before production adoption.
ai · api · artificial intelligence · deep learning · developer tools
