Is it an RNN or a state space one, like qwen or there was an arch called mamba if I remember correctly. Or it might be closer to RWKV.

Edit: I checked and it is similar to linear delta net uses by qeen.