llm-inference.

Listed 3Updated Sep 10, 2026

Rank 1. litgpt20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.apache-2.0 · linuxGitHub stars: 13.7k
Rank 2. incognideExplore the unknown, build the future, own your data.mit · linuxGitHub stars: 471
Rank 3. matrixhubAn Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.apache-2.0 · linux, dockerGitHub stars: 350