| ▲ | onlyrealcuzzo 26 minutes ago | |
Fable & Opus, Astra & Sol, and Carbon are all thought to be >1T param models - AFAIK, most people think Opus & Sol are ~5T param models and Astra, Fable are 10T+. I think the rumor-mill consensus is that Google's models are significantly smaller while attempting to swing at the same level - but the ratios AFAIK are thought to be around the same - i.e. Neon is somewhere around half as big as Carbon, big enough that a newer checkpoint can make it temporarily a little bit better. | ||
| ▲ | ml-anon 5 minutes ago | parent [-] | |
So many figures and ratios pulled from a single ass | ||