Log-Linear Attention

Han Guo, Songlin Yang, Tri Dao, and Yoon Kim (ICLR 2026): generalizes linear attention and SSMs to a logarithmically-growing state — between O(1) recurrent and O(n) full attention — with hardware-efficient chunked kernels. The strongest MIT architecture result of the window and the theoretical spine of the flash-linear-attention line.