| ▲ | onlyrealcuzzo 2 hours ago | |
Benchmarks don't do a good job at capturing the difference in quality of frontier models over smaller models. Opus 5.5 was so good that if it wasn't nerfed - at least just looking at the benchmarks - the difference in cost here does not seem to justify using this for anything besides design and review. That's like maybe 1% of total token usage for SWE BUT a better design can have enormous benefits, so it's almost always worth using the best model for that. | ||