Given that it is the general consensus that a step function occurred with Opus 4.5/4.6 only 3 months ago - it seems like an insane omission.

▲

jeremyjh 15 hours ago | parent | next [-]

This has been the general consensus for about three years now. "Drastic increases in capability have happened the last 3-6 months" have been a constant refrain.

Without any data from the study past September I think its not unreasonable, if you want to make an argument based on evidence.

For me personally, I agree with you, I'm really seeing it as well.

▲

postflopclarity 15 hours ago | parent [-]

> "Drastic increases in capability have happened the last 3-6 months" have been a constant refrain.

well, yeah. because that's been the experience for many people.

3 years ago, trying to use ChatGPT 3.5 for coding tasks was more of a gimmick than anything else, and was basically useless for helping me with my job.

today, agentic Opus 4.6 provides more value to me than probably 2 more human engineers on my team would

	▲	josephg 15 hours ago \| parent \| next [-]
		Yep this has been my experience too. I tried GPT3.5 for translating code from typescript to rust. It made many mistakes in rust. It couldn't fix borrow checker issues. The context was so small that I could only feed it small amounts of my program at a time. It also introduced new bugs into the algorithm. Yesterday I had an idea for a simple macos app I wanted. I prompted claude code. It programmed the whole thing start to finish in 10 minutes, no problem. I asked it to optimize the program using a technique I came up with, and it did. I asked it to make a web version and it did. (Though for some reason, the web version needed several rounds of "it doesn't work, here's the console output"). I'm slowly coming to terms with the idea that my job is fundamentally changing. I can get way more done by prompting claude than I can by writing the code myself.
	▲	suddenlybananas 15 hours ago \| parent \| prev [-]
		>well, yeah. because that's been the experience for many people. Yes but this blogpost argues that at least over the course of 2024 to the end of 2025, those people were mistaken.

▲

Toutouxc 15 hours ago | parent | prev | next [-]

There's a consensus that SOMETHING changed with Opus 4.5. It might have been the "merge rates" metric, it might have not.

I'm certainly getting faster and cleaner-looking solutions for certain issues on Opus 4.6 than I was 5 months ago, but I'm not sure about the ability to solve (or even weigh in) the actual hard stuff, i.e. the stuff I'm paid for.

And I'm definitely not sure about the supposed big step between 4.5 and 4.6. I'm literally not seeing any.

▲

15 hours ago | parent | prev [-]

[deleted]