A concise but complete full-attention transformer with a set of promising experimental features from various papers
Catalog snapshot
Repository health snapshot: 519 forks and 76 open issues at review time. Platform support is inferred conservatively from repository topics.
A concise but complete full-attention transformer with a set of promising experimental features from various papers Fossfits includes x-transformers as an actively maintained llm infra option: its public repository was updated on 2026-09-02, uses the MIT license, and had 5,944 stars when reviewed. Check its documentation and release notes before production adoption.
artificial intelligence · attention mechanism · deep learning · transformers