TinyLLM

Setup and run a local LLM and Chatbot using consumer grade hardware.

Project.

Catalog snapshot

License: MIT
Platforms: Linux
Docker: No
Commercial use: Allowed
Stars: 348
Language: JavaScript
Last commit: Nov 23, 2025
Tags: artificial-intelligencechatbotlarge-language-modelsllama-cpp-pythonllmopenai

Repository health snapshot: 40 forks and 7 open issues at review time. Platform support is inferred conservatively from repository topics.

About.

Setup and run a local LLM and Chatbot using consumer grade hardware. Fossfits includes TinyLLM as an actively maintained rag apps option: its public repository was updated on 2025-11-23, uses the MIT license, and had 348 stars when reviewed. Check its documentation and release notes before production adoption.

artificial intelligence · chatbot · large language models · llama cpp python · llm

Nearby.

All RAG and app builders

FFlowiseLow-code node UI on top of LangChain-style flows.Compare
AAnythingLLMDesktop and server chat with documents, agents, and many backends.Compare
KKhojSelf-hostable AI second brain that searches your notes, docs, and the web.Compare
DDifyVisual LLM app builder with RAG, agents, and a backend.Compare
RRAGFlowOpen-source RAG engine with deep document understanding.Compare