Skip to content
Fossfits

LLM infrastructure.

Serving, gateways, and observability around models. Heavier than a chat UI. Closer to production traffic.

Sorted by Most popular

  1. J-WashJacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian Lens. Results are exportable.Apache 2.0 · Linux230
  2. MambaTransformerIntegrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence ModelingMIT · Linux228
  3. simple-hierarchical-transformerExperiments around a simple idea for inducing multiple hierarchical predictive model within a GPTMIT · Linux228
  4. doormanEnterprise AI and API Gateway with GovernanceApache 2.0 · Linux226
  5. hubHigh-scale LLM gateway, written in Rust. OpenTelemetry-based observability includedApache 2.0 · Linux225
  6. flash-cosine-sim-attentionImplementation of fused cosine similarity attention in the same style as Flash AttentionMIT · Linux221
  7. llm7.ioLLM7.io offers a single API gateway that connects you to a wide array of leading AI models from various providers.AGPL-3.0 · Linux217
  8. dreamer4Implementation of Danijar's latest iteration for his Dreamer line of workMIT · Linux215
  9. UFund-miniprogramQbot 微信小程序: 自选基金/股票助手、策略选股、股票盯盘、量化投研智库GPL-3.0 · Linux211
  10. AI-Resume-Analyzer-and-LinkedIn-Scraper-using-Generative-AIDeveloped an AI application using LLM to analyze user resumes and provided the summarization, strengths, weaknesses, suggestions, suitable job titles, and also scraping job details from LinkedIn using Selenium. This application reduces time by 30% and helps candidates tailor their resumes effectively.MIT · Linux208
  11. Project_Chronos⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with Hybrid MLA+Sliding Window Attention.Apache 2.0 · Linux205
  12. clipspyPython CFFI bindings for the 'C' Language Integrated Production System CLIPSBSD 3-Clause · Linux203
  13. bidirectional-cross-attentionA simple cross attention that updates both the source and target in one stepMIT · Linux199
  14. jetson-packages-familyThe ultimate software installation guide for Nvidia Jetson Nano/Xavier Dev KitMIT · Linux196
  15. tiny-recursive-modelUnofficial implementation of Tiny Recursive Model (TRM), improvement to HRM from Sapient AI, by Alexia Jolicoeur-MartineauMIT · Linux192
  16. secmlA Python library for Secure and Explainable Machine LearningApache 2.0 · Linux192
  17. plugin-ghidraRevEng.AI Ghidra PluginGPL-3.0 · Linux192
  18. RamanSPyRamanSPy: An open-source Python package for integrative Raman spectroscopy data analysisBSD 3-Clause · Linux191
  19. hyper-connectionsAttempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the publicMIT · Linux189
  20. DNAnalyzerPrecision genomics for everyone, everywhere. Powered by private AI.MIT · Linux186

181–200 of 204