| ▲ | throwdbaaway 2 hours ago | |
I would say 27B matches with Sonnet 4.0, while 397B A17B matches with Opus 4.1. They are indeed nowhere near Sonnet 4.5, but getting 262144 context length at good speed with modest hardware is huge for local inference. Will check your updated ranking on Monday. | ||