Remix.run Logo
cubefox 5 hours ago

I would expect this only to be true for linear architectures like Mamba or Gated DeltaNet. Transformers and hybrid architectures do not have constant compute cost per token.

monkpit 4 hours ago | parent [-]

Performant could certainly mean “higher performing” and not “quicker”.