To me context means everything. Tokens per second is a great metric but in the real world context window is the deal breaker when a real use case is on the table.

Gemma 4 26B is capable up to 256k or 262k, can't remember which.

Whether the writer's setup affects that choice I don't know.