| ▲ | benwills a day ago | ||||||||||||||||||||||||||||||||||||||||||||||||||||
I noticed Fable decline in quality a couple weeks ago. And I've noticed Opus drop over the last week, even after bumping to a default of Extra High reasoning for almost everything. Tonight has been maddening with the kinds of absurd mistakes it's repeatedly making. It's so frustrating. I'm the kind of person that wants something to be consistent and reliable. And Anthropic has been great, except for in this way. Which is enough of a recurring frustration (about every couple months this year) that I genuinely can't wait for other options to catch up. Then I'll be leaving as soon as I can. I just don't know how long that will be. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | jdcasale a day ago | parent | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
I've been using Fable for a couple months as a relatively independent, long-horizon task executor and it worked well. About two weeks ago it completely stopped working. Like ~85% success rate down to ~10% in my workflows. Totally possible that I'm just hallucinating/projecting/etc or my workflows somehow changed in terms of difficulty, but it's been kind of shocking. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | my-huge-pony a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
>I'm the kind of person that wants something to be consistent and reliable And people wonder why open models are a big deal, and why some people love them so much, despite being 30% worse than the frontier. Having control over something that writes most of your code is important. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | jann a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
I read somewhere that the test might switch models mid conversation which stops the other from reading the previous model's reasoning. I don't know if that's true, but it sure feels like that quite often in the last days. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | matheusmoreira a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
> I'm the kind of person that wants something to be consistent and reliable. Only local AI capable hardware and frontier open weight models can provide that. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | giwook a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Bumping to a default of extra high reasoning for almost everything seems ill-advised. "More reasoning" != "better" | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | dr_dshiv a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Surprised they didn’t wait till after the IPO. Any guesses on how models might change then? | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | bluerooibos a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
> I'm the kind of person that wants something to be consistent and reliable Surely everyone is that kind of person. Who wants to pay for a service that doesn't work properly half the time? | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | stavros a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Oh don't worry, you can just switch to Fable 5.5 tomorrow, which is the smartest model so far (because the others are dumb now). | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | steve_taylor a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Fable has most definitely been nerfed for the last few weeks, not to mention painfully slow. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | aleqs 21 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
I just cancelled my x20 anthropic sub after their last usage reduction shenanigans, and moved over to DeepSeek and opencode go. Yeah opus is a bit smarter, but not even close to justify the 20x price relative to DeepSeek. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | tntpgh a day ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
I'm a pretty voracious 20x user, and OAI Biz Pro user; however I'm not an engineer by training, a previous tech adjacent dev team leader who always relied on pseudo code and broadening my horizons when dealing with my team. ( AdTech, DTC marketing ) So I'm AI pilled and in another career, and started to think, what if the problem is the inputs? They release Opus X.X and at first it's a rush of their best users, best use cases, upgraded lanes. As weeks go on, adoption increases, cruft uses start to poison the model? Is this how the ongoing evolution works? I'd love to get Sonnet 5.5 and Opus for review in a place where I could reliably daily drive for X months / Y years etc. | |||||||||||||||||||||||||||||||||||||||||||||||||||||