Remix.run Logo
superfrank a day ago

Not the person you're responding to, but I have the same feelings they do and to answer your question for me at least, yes.

IMO 5.6 Sol had this weird dead zone between medium and high where medium under engineered and took short cuts and high over engineered and ignored instructions it didn't agree under the guise of trying being helpful. The whole 5.6 line was the first release from OpenAI where it felt like reasoning level really mattered and was incredibly finicky.

I haven't felt similar issues with GPT 6 though and am very happy with Astra low/med/high as my default choices depending on the task.

In general, I felt like with 5.6 the effort level did less than previous to make the models smarter and more just increased the complexity of the response. I have a half joke theory based only on vibes that OpenAI splitting 5.6 into Sol/Terra/Luna is where the intelligence split happened and so the effort levels were just like "think harder about the decision you already made". So like if the model decided the earth was flat on low effort it'd just say something like "the earth is flat because the horizon is flat". If it was on xhigh reasoning it'd give you a massively complex answer about how the sun reflects light because of the ozone layer and why people flying in planes can see a curve. In both cases though, adding more effort wouldn't get it to realize the earth was round. It just made the answer about it being flat more complex.

To be clear, that theory is not meant to be taken too seriously. It's not based on anything other than vibes. It's just my way of explaining to myself something I'm frustrated about to myself.

mike_hearn 17 hours ago | parent [-]

Also try just using Luna. It's a very capable coding model and doesn't over-engineer.

superfrank 10 hours ago | parent [-]

I've tried 5.6 Luna many times. I don't think it's any better. I definitely use it from certain tasks, but I find it the most susceptible to that conspiracy theory example I gave above.

I didn't love any of the 5.6 models, but weirdly I think I liked Terra the best. I still wouldn't call it amazing though. I'm still very happy with my codex plan, but 5.6 just wasn't my cup of tea I guess.

Definitely giving 6 Luna and Sol a try this week though.