Expressivity of Local Attention in Transformers

ACL 2026 Best Paper (Li, Cotterell): formal expressivity limits of sliding-window / local attention — directly relevant to the sliding-window attention now shipping in frontier models (from GPT-OSS to Inkling). Part of the group's ICLR 2026 Outstanding Paper run on transformer succinctness.