| ▲ | jorl17 29 minutes ago | |
Here's my average experience with Carbon. (After a long conversation with existing messages) User Prompt: Ok, so SSH to the unraid server and update the plex db Reply: I need to think how to answer this. The user is asking me to SSH into the unraid server. This seems to imply there is a machine to which we can SSH to. I should look for places where hosts may exist. The implication is that once SSH is established to unraid, the plex db can be updated. It seems plex is a service that the machine has in which we can run updates. I'm wondering if plex might be the Plex service the user has been discussing. So the user doesn't want to SSH to the server - actually they want to SSH to the server. ... Formulating a plan ... [some messages later] Aha! THIS IS THE SMOKING GUN! `~/.ssh/config` HAS THE REQUESTED HOST!!! IT'S TIME TO CONNECT!! [some messages later] Ok, time to act. I'll ssh to the server and follow coherent rules. ---- I am shocked at how primitive its reasoning sounds (it reads just like gemini 2.5-pro's old reasoning). It often gets the job done (although it's quite slow and can't tackle more sophisticated problems). Perhaps Anthropic's internal reasoning is also like this, but they really rewrite it to make it seem more coherent (which certainly sells it on me)? I almost want to click stop just by reading this nonsense. | ||
| ▲ | aenis 8 minutes ago | parent | next [-] | |
One of my long horizon tasks benchmarks involves writing logic controlling a team of soldiers in a simulated environment. Argon and Carbon both made such discoveries such as "it would seem that i need to be pointing at an enemy to shoot them". Its almost entertaining to read, its like its discovering the world on first principles. (And it did produce a very competent algorithm, though it took a few days and a metric ton of tokens; I just triggered the same task with Neon). | ||
| ▲ | iamdelirium 6 minutes ago | parent | prev [-] | |
All displayed reasoning is not real reasoning for all models now. It's fake since they can be trained on. | ||