Attend at the Right Resolution: Head-Adaptive Sparse Attention via Query-Key Interaction Structure

arXiv:2611.09700v1 Announce Type: new Abstract: Attention is a major scalability bottleneck in large language models (LLMs), with its computational cost and key-value (KV) memory traffic becoming increasingly prohibitive as context length grows.