MoBA: Mixture of Block Attention for Long-Context LLMs

paper
Moonshot AI
Mixture of Block Attention mechanism for efficient long-context processing.
Paper (arXiv)GitHub

Paper

Citations 1
arXiv HTML
scalingattentionarchitecture

More Links