LLM infrastructure.
Serving, gateways, and observability around models. Heavier than a chat UI. Closer to production traffic.
Sorted by Most popular
- eureka-ml-insightsA framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.Apache 2.0 · Linux185
- ChaKt-KMP✨ChaKt - A multiplatform chat-prompt based app for Android, iOS, Desktop, Web. Powered by Google's Gemini API (with Generative AI Multiplatform SDK)MIT · Linux, macOS, +3185
- coconut-pytorchImplementation of 🥥 Coconut, Chain of Continuous Thought, in PytorchMIT · Linux184
- J.A.R.V.I.SJarvis from the marvel universeMIT · Linux182
201–204 of 204