It seems like someone at X.ai likes maxing benchmarks but real world usage shows it significantly behind frontier models.

I do appreciate their desire to be the most popular coding model on OpenRouter and offer Grok4-Fast for free. That's a notable step down from frontier models but fine for lots of bug fixing. I've put hundreds of millions of tokens through it.