By the way; I found that DeepSeek says that it is even an "ideal complement to modern MoE architecture"

https://arxiv.org/abs/2601.07372v1