Titans has a new approach to longer and faster memory compared to transformers.

https://arxiv.org/html/2501.00663v1