| ▲ | phoghed 2 hours ago | |
> and intelligence appears to be markedly declining Serious question: does anyone have evidence of this? It’s something that’s constantly asserted, and has been since 2023. Every time someone posts a site that tries to track this though, I look at it and it’s just a flat line. | ||
| ▲ | conception 8 minutes ago | parent [-] | |
https://marginlab.ai/trackers/codex/ By and large they don’t. I have seen this drop a few times, eg before fable came out opus dropped a lot probably due to less compute available. My guess is it’s a combination of getting used to the new cliff models fall off on and forgetting that model performance drops significantly when context fills up. So new model comes out, people try it and it’s amazing on a task or two. Then they start using it, context window fills up and it gets a lot worse. | ||