litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Project.

Catalog snapshot

License: Apache 2.0
Platforms: Linux
Docker: No
Commercial use: Allowed
Stars: 13.7k
Language: Python
Last commit: Sep 9, 2026
Tags: aiartificial-intelligencedeep-learninglarge-language-modelsllmllm-inference

Repository health snapshot: 1,497 forks and 288 open issues at review time. Platform support is inferred conservatively from repository topics.

About.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. Fossfits includes litgpt as an actively maintained fine tuning option: its public repository was updated on 2026-09-09, uses the APACHE-2.0 license, and had 13,660 stars when reviewed. Check its documentation and release notes before production adoption.

ai · artificial intelligence · deep learning · large language models · llm

Nearby.

All Fine-tuning

LLLaMA-FactoryWeb UI and YAML recipes for fine-tuning many open LLMs.Compare
TtorchtunePyTorch-native library for fine-tuning LLMs with recipes.Compare
DDeepSpeedMicrosoft’s Apache-2.0 ZeRO optimizer for multi-GPU, multi-node LLM training.Compare
Ppytorch-lightningPretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.Compare
UUnslothFaster LoRA fine-tuning with lower VRAM on consumer GPUs.Compare