| ▲ | cubefox 5 hours ago | |
I would expect this only to be true for linear architectures like Mamba or Gated DeltaNet. Transformers and hybrid architectures do not have constant compute cost per token. | ||
| ▲ | monkpit 4 hours ago | parent [-] | |
Performant could certainly mean “higher performing” and not “quicker”. | ||