By design. At least until we move away from attention being at the core of LLMs