Remix.run Logo
jnovek 3 hours ago

I’m so confused in these comments right now — I thought you had to load an entire MoE model and sparseness just made it so you can traverse the model more quickly.