Remix.run Logo
MyFirstSass 5 hours ago

I've gone back to 4.8.

5 would constantly veer of in random directions if not working from 100% strict and narrow instructions.

I find it weird there's not more discussion here on HN on how the most used model now has clearly degraded in quality and it seems we've hit a peak and are on a downslope - because the model is clearly smaller or more economical for Anthropic no doubt about it, and the benchmaxxing they do is pure marketing bs - Fable in my view has also been not much better than 4.6 or 4.8 after a few days, disregarding the insane amounts of astroturfing and marketing everywhere.

Theres thousands of threads of twitter, reddit and the internet at large but silence here. Weird but not weird as crypto bs was also insufferably rampant here for a while.

Personally i think we've hit the top of the subsidisation phase and prices will probably 10-15x soon as foreshadowed with both API price policy changes from all the big providers, and now the 1100% deepseek API price changes from yesterday, this could domino into a market implosion and an AI winter, because expecting growth from the bizarre bubble carousel investments with little ROI atm is just not viable.

A bit worried about this as i've already grown quite accustomed to these tools.

barrkel 2 hours ago | parent | next [-]

I have a chunky bit of functionality in my hobby app using babylon.js to render 3D worlds using things like portals and LoD rendering to manage the visual load. I built it out with a combo of Fable and Opus 5.

I too got fed up with the prose of Opus in particular, and tried going back. Unfortunately, the previous models were less able to hack it. The prose was better but progress was worse.

It wasn't just conversation and comments. Some of the function names were wild. Like it instead of something like "isSolidWall(x)" it would write something like "weightyNotEphemeral(x)" or something - that's not quite it, but it really did embed overwrought antithesis into the identifier instead of a straightforward positive predicate.

munksbeer 3 hours ago | parent | prev | next [-]

> I find it weird there's not more discussion here on HN on how the most used model now has clearly degraded in quality and it seems we've hit a peak and are on a downslope

It's not weird, because it's an anecdote, not an accepted fact.

Personally I've not been too happy with Opus 5, but I've had similar experiences with other models previously, feeling like they didn't quite fit with my working style.

So nothing indicates we've hit a peak.

MyFirstSass 3 hours ago | parent [-]

I'll say everything indicates we've hit or are near peak for the masses at least (unless you start paying 50x more) but to each his own.

4.6 was best for us and right now yeah OpenAI and others are edging forward, but slower while prices are increasing industry wide as much as 20x, time to completion is increasing wildly and i'm sure they'll do the same over at OpenAI as their compute constraints also start to take a toll ie degrade performance.

In my view 4.6 era was way faster and with less weirdness so we've gone downwards at least in my company, 4.7 was ridiculous, then 4.8 was almost 4.6 level, 5 is even worse than 4.7 - so it's not a bit up and down its down then a little up then further down.

And all of this is against a backdrop of zero ROI in this sector - so it makes sense we've hit a peak and we're now seeing the subsidisation phase begin to falter, will there be better models certainly but only for short amounts before they get quantised (or whatever is happening behind the scenes), and with diminishing returns over huge prices increases and slower responses.

bredren an hour ago | parent | prev | next [-]

It is bizarre. There has been no statement, no mention of even hearing concern about Opus 5.

I presume something is forthcoming, but it may be they don’t want to come empty handed—-5.1 is intended to “fix the glitch.”

edg5000 3 hours ago | parent | prev | next [-]

We can use OpenRouter pricing to get an idea about what competitive inference pricing is like without R&D or other costs, and indeed we'd be screwed if we had to pay those rates. We'd go from 100-200 USD to 2000-4000 USD/m.

vachina 2 hours ago | parent | prev | next [-]

yeah I feel the same way with Opus 5 too. If I ask it to do something, it would go ahead and rewrite unrelated things and then in a less performant version of it.

I’ve instead moved to GLM, at least it has the courtesy to ask some steps of the way what I wanted exactly and only work on what I asked.

empath75 an hour ago | parent | prev | next [-]

Opus 5 has a habit of taking what I asked for, doing something tangentially related to it, and then lying to me and saying it did exactly what I asked.

logicchains 3 hours ago | parent | prev [-]

>it seems we've hit a peak and are on a downslope

Sol and Fable are great; we haven't hit a peak, Anthropic just tried to pull a fast one on its customers with Opus 5.0.