N
native-sparse-attention-pytorch
Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
Project.
Catalog snapshot
- License
- MIT
- Platforms
- Linux
- Docker
- No
- Commercial use
- Allowed
- Stars
- 813
- Language
- Python
- Last commit
Repository health snapshot: 52 forks and 12 open issues at review time. Platform support is inferred conservatively from repository topics.
About.
Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper Fossfits includes native-sparse-attention-pytorch as an actively maintained llm infra option: its public repository was updated on 2025-08-15, uses the MIT license, and had 813 stars when reviewed. Check its documentation and release notes before production adoption.
artificial intelligence · attention · deep learning · sparse attention
