Remix.run Logo
▲ Grimblewald 19 hours ago

If required, so far I'm not impressed with newest proprietary. i have a claude sub mostly rotting at this point, so i come back from time to time until the year long sub expires, but at this stage i will not renew and see no point in doing so.

▲meowface 18 hours ago | parent | next [-]

Have you tried Opus 5.5 and Fable 5.1? They're still better than any of the available open-weights models. (And rumors are Fable 5.5 is coming out tomorrow or next week.)

▲hatefulmoron 18 hours ago | parent | next [-]

I have a Claude $200 (Ultra these days) plan and use Opus 5.5 for work with ultracode workflows and all the rest every day. I also use DeepSeek V4.1 Flash 1107 through a separate subscription plan with Pi.

Using DeepSeek I've made the Wayland compositor I use every day. It's finished now in the sense that it doesn't crash or have any bugs, nor can I think of any features to add or anything to change.

When somebody else is paying, I'll absolutely just throw Opus 5.5 at it. Who cares. It gives the best chances that the output is what I want, at no extra cost to me. But for my personal projects, using DeepSeek in Pi with a workflow extension is competent.

Sorry for throwing lots of text at you. All of this to say there's more to it than just which model is more intelligent. There's also speed, cost, and "good enough". Perhaps the problems I'm working on right now are just not complicated enough for "Opus is better" to be a real selling point.

▲Grimblewald 18 hours ago | parent | prev [-]

Have used 5.5, ran usual battery of tests, and the downhill death spiral in a science/chemistry context continues. Code wise, it is better than open weight in several ways, but you really have to work hard to fight it from creating such a heavily abstracted mess it becomes unmaintainable for humans. Requires too much handholding for me. It's scientific reasoning is more confident as well, which would be great if it were also more correct.

Open weight models are generally more humble when working at fronteir, seek human input more reliably on thi gs they have no buisness deciding on, and can be trusted to not fuck up codebase in some way. Also, the way claude talks by default and tends towards even with all the "use this standard or that" tricks, grinds my gears in a way that drive me postal.

So, all in all, the shit prose, the constant oversight robbing me of attention better spent elsewhere, and high cost, and seemingly correct and difficult to catch errors on first pass make avoidance/non-reliance a nobrainer.

When dumb models are right, they're right, because likely its a solved problem elsewhere, and when they're wrong its quite transparent. Claude and fable are extremely good at spinning resilliant bullshit that can take quite some mental labor to verify and disprove, usual problem is flawed or deeply i correct assumptions on top of which then relativly sound reasoning and evidence is layered, or otgerwise weird contradictory decisons made "because i thought it would be better this way" that waste 48 hours of gpu time on an invalid model because claude fucked the one small part entrusted to it, which was extremely well defined and reasoned/backed by literature and it just made an executive decision to deviate without consulting or warning about it.

so fuck claude.

▲noosphr 16 hours ago | parent | prev [-]

I was seriously underwhelmed by the previous generation, reminded me of the hype around gpt2 being too dangerous to live from the same people.

At least Gemini 4 Argon has made writing the front ends I hate and don't care about a breeze.

I have no idea how much that's worth to other people, but it's more than worth the account or three I use.

▲meowface 12 hours ago | parent [-]

IMO there's no point commenting on it unless you've actually tested using Opus 5.5. You can't assess the status quo based on even one generation prior.