i thought open models weren't SOTA. therefore not neck and neck... in your experience, do you think it depends on your type of work?

They're about half a gen behind. Very impressive to get this kind of utility from a flash series model... the impact of RL seems to be behind much of the coding and agentic improvements lately.

In my experience, for coding, they are pretty much SOTA. Maybe not for other sciences and problem solving.