Remix.run Logo
iamcoder18 3 hours ago

There's no way GPT 5.5 is better than GPT 5.6 Sol, and gemini-3.6-flash is better than both of those. I wouldn't trust this benchmark at all.

zuzululu 17 minutes ago | parent [-]

benchmark is saturated but your claim that gemini-3.6-flash is better than 5.6-sol is also not trustworthy or accurate.

maybe if you mentioned 3.7-flash it might have been slightly more believable (but still false).

MostlyStable 11 minutes ago | parent [-]

He was remarking on how unbelievable it was. He sentence is a little bit hard to parse but he's saying that both 5.5 being better than 5.6 AND Gemini 3.6 scoring better than both are signs that this benchmark is not very useful.

The reason for both of those things is, as you point out, the benchmark is very obviously saturated