Remix.run Logo
▲ godbox an hour ago

What a snooze fest. Another model that does not meaningfully improve on intelligence or price compared to its peers. Google has basically announced that they've "caught up" with the rest. I think they've been doing great work in the Flash department so seeing this is... underwhelming?

▲augment_me 38 minutes ago | parent | next [-]

I found that Google does not benchmaxx as much as the other providers. Of you look at real-case evaluation like lm-arena, even the 3.8 flash is often near the top despite its benchmark index being worse.

▲losvedir 43 minutes ago | parent | prev | next [-]

The only models beating it are on "max", while this is "high". There's no guarantee that those effort / reasoning levels compare, but there's almost certainly an "xhigh" or "max" version later which will score higher there.

▲enraged_camel an hour ago | parent | prev [-]

Based on some... rumors I've heard, this is their "Pro" offering. There is supposed to be an Ultra coming as well.