Remix.run Logo
▲ onlyrealcuzzo 26 minutes ago

Fable & Opus, Astra & Sol, and Carbon are all thought to be >1T param models - AFAIK, most people think Opus & Sol are ~5T param models and Astra, Fable are 10T+.

I think the rumor-mill consensus is that Google's models are significantly smaller while attempting to swing at the same level - but the ratios AFAIK are thought to be around the same - i.e. Neon is somewhere around half as big as Carbon, big enough that a newer checkpoint can make it temporarily a little bit better.

▲ml-anon 5 minutes ago | parent [-]

So many figures and ratios pulled from a single ass