Attention is all you need, as the transformative paper (pun definitely intended) put it.
Unfortunately, you're only getting attention in 3 second chunks.