C
CoLT5-attention
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
Project.
Catalog snapshot
- License
- MIT
- Platforms
- Linux
- Docker
- No
- Commercial use
- Allowed
- Stars
- 231
- Language
- Python
- Last commit
Repository health snapshot: 15 forks and 3 open issues at review time. Platform support is inferred conservatively from repository topics.
About.
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch Fossfits includes CoLT5-attention as an actively maintained llm infra option: its public repository was updated on 2026-08-14, uses the MIT license, and had 231 stars when reviewed. Check its documentation and release notes before production adoption.
artificial intelligence · attention mechanisms · deep learning · efficient attention · routing
