MoBA: Mixture of Block Attention for Long-Context LLMs

paper
Moonshot AI
Mixture of Block Attention mechanism for efficient long-context processing.
Paper (arXiv)GitHub

Paper

Citations 2
arXiv HTML
scalingattentionarchitecture

More Links