| ▲ | seizethecheese an hour ago | |||||||
Yeah, in real SWE tasks, 6.1 is bad. We've been trying to capture real SWE data by building a battle system on top of OpenCode. In our data, Sol 6.1 is seriously underperforming, I'm talking worse than DeepSeek 4.1 Flash, at 10x the cost. (Though to be fair, statistically they are tied in performance, though not at all in cost. https://agentduel.com/leaderboard .) (It's possible for a tiny model to do better than a large one because contrary to typical Arena methodology we think a fast good enough answer is better than a slow one.) OpenAI performance on our system has been bad enough I switched to Anthropic models for my daily work. | ||||||||
| ▲ | locusofself an hour ago | parent | next [-] | |||||||
I've been building quite a complex desktop app (a digital audio workstation) using 6.1 Sol and it's been very good for me | ||||||||
| ||||||||
| ▲ | throwitaway222 21 minutes ago | parent | prev | next [-] | |||||||
I'm guessing you don't use codex though- the harness + model combo makes a difference. | ||||||||
| ▲ | slekker an hour ago | parent | prev [-] | |||||||
Is this an ad? | ||||||||
| ||||||||