I mean to me even difference between Opus and Sonnet is as clear as day and night, and even Opus and the best GPT model. Opus 4.6 just seems much more reliable in terms of me asking it to do something, and that to actually happen.

▲

acidtechno303 28 minutes ago | parent | next [-]

You're quick to say "to me" in your comparison.

My experience is very different than yours. Codex and CC yield very differenty result both because of the harness differencess and the model differences, but niether is noticeably better than the other.

Personally, I like Codex better just because I don't have to mess with any sort of planning mode. If I imply that it shouldn't change code yet, it doesn't. CC is too impatient to get started.

▲

Philip-J-Fry 2 hours ago | parent | prev [-]

It depends what you're asking it though. Sure, in a software development environment the difference between those two models is noticeable.

But think about the general user. They're using the free Gemini or ChatGPT. They're not using the latest and greatest. And they're happy using it.

And I am willing to bet that a lot of paying users would be served perfectly fine by the free models.

If a capable model is able to live on device and solve 99% of people's problems, then why would the average person ever need to pay for ChatGPT or Gemini?

	▲	mewpmewp2 44 minutes ago \| parent [-]
		But even other tasks, like research etc, where dates are important, little details and connections are important, reasoning is important, background research activities or usage of tools outside of software development, and this is where I am finding much of the LLMs most useful for my life. Even Opus makes mistakes with dates or not understanding news and everything correctly in context with chronological orders etc, and it would be even worse with smaller and less performing models. Scheduling, planning, researching products, shopping, trip plans, etc...