NSA: Native Sparse Attention

paper
DeepSeek
Hardware-aligned and natively trainable sparse attention mechanism.
Paper (arXiv)

Paper

Citations 2
arXiv HTML
attentionarchitectureefficiency

More Links