An implementation of local windowed attention for language modeling
Catalog snapshot
Repository health snapshot: 49 forks and 5 open issues at review time. Platform support is inferred conservatively from repository topics.
An implementation of local windowed attention for language modeling Fossfits includes local-attention as an actively maintained local ai option: its public repository was updated on 2025-07-16, uses the MIT license, and had 505 stars when reviewed. Check its documentation and release notes before production adoption.
artificial intelligence · attention mechanisms · deep learning