Remix.run Logo
devin 4 hours ago

Honest question/comment for you and the parent: I find these subjective experience reports pretty empty without an understanding of your level of experience, the problem space you're working in, etc.

skerit 3 hours ago | parent | next [-]

I think the improvement on how it codes is pretty much represented correctly by the benchmarks (a nice bump, but not some crazy leap)

But where it really shines is in how NOT lazy it is. Fable requires less hand-holding. And I can understand how someone who uses Claude-Code sparingly and with very focused prompts would not see a lot of improvement there.

But simple example: if you ask Opus to do a review of the codebase (with a short prompt and not too much guidance), I've had it basically read the `git log` output, do a simple `ls` and have it declare "Everything looks great! No problems found!", when Fable really does what you would expect it to do.

And you might think: "oh, so it's just capable of handling crap prompts?", well sure. But even if you make THE PERFECT Opus plan (a plan that would take many turns/hours to finish), Opus will fake out, say everything is done, and then you see that half of the plan was deferred, half of the functions are ridiculous stubs, ...

If you give the same plan to Fable, it'll just DO IT. And it WILL get it done. And in the end it'll tell you "Oh, I also found 30 other bugs and I fixed all of them properly" (where Opus would have started crying, or WORSE, worked around the bugs)

esperent 2 hours ago | parent | next [-]

> Opus will fake out, say everything is done, and then you see that half of the plan was deferred, half of the functions are ridiculous stubs, ...

Doesn't Claude Code have a /loop command? Give it a message to keep it on track overnight, send every 20m, make it track progress in a doc, reread the doc after every loop. I've found this works well for a certain class of problems, most importantly where the actual work is getting done by very narrowly focused batches of subagents, with the main session just coordinating and keeping the doc updated.

hadlock an hour ago | parent | next [-]

They added a "/goal" command which I guess spawns a supervisor agent process that checks to see if your goal statement has been achieved (e.g. "/goal complete tasks 1-250 of plan.md") I've been pretty happy with it but I rarely use that workflow. Most of the time I give it a 3-6 step prompt and come back in 20 min and the first two were done and I get a summary "up next is to complete the next steps" which.... Opus 4.6 didn't have this problem. 4.8 feels like a cost cutting measure, or maybe it's just tuned poorly for my specific workflow (multi-repo system integration)

whatinthe67 2 hours ago | parent | prev [-]

For optimizations or proofs I suppose? Wouldn't know why else you would do something like that.

flatline 3 hours ago | parent | prev [-]

I think the parent comment stands - I’ve asked Opus to do a review of DeepSeek’s test suite and told it a couple things I wanted it to look for, and it did a very thorough review of the tests and picked out a reasonable number of gaps and tautological tests. It’s a mix of prompting/instructions, the agent harness, and random chance. The model is not wholly irrelevant but IMO increasingly so.

hombre_fatal 2 hours ago | parent | prev | next [-]

20 yoe, application/systems stuff, and I always run models on xhigh or max effort level.

Fable has been more intelligent, with better taste and defaults (e.g. make impossible states impossible without being told, build for testability), and considers/solves things that Opus did not.

My workflow is to run Claude in planning mode first to spit out a plan file and then review->revise cycle it with Codex or other agents.

One big tell is that Opus will say that it can't find any more revision advice for a plan file, yet Fable will find more issues but also smart pivots into better solutions. This is probably the best test since it's not based on vibes.

garyrob 3 hours ago | parent | prev | next [-]

I'm doing work with fairly complicated cryptographic algorithms and math. I'm finding Fable 5 to be a significant stop better than Opus 4.8, but that Opus occasionally comes up with something small but nontrivial that Fable missed. (The reverse is true much more often.)

jesse_dot_id 3 hours ago | parent [-]

That's the delta in our use cases then, I suppose. I'm not doing anything super novel. DevOps work, web application development — things that typically do not stump the agent(s) when given time to iterate.

muglug 2 hours ago | parent | prev | next [-]

15+YOE. Fable 5 is well above the level of Opus. I have used it alongside Opus for a range of hard problems, including porting a large static analysis tool to Rust, building various tooling around .pptx and .xlsx documents.

In all cases, Fable clearly outperformed Opus.

andy99 2 hours ago | parent | prev | next [-]

What is your view on how experience and problem space relate to subjective experience.

For example will inexperienced or experienced users see a bigger jump in subjective quality?

nprateem 3 hours ago | parent | prev [-]

It still does stupid stuff like leave unnecessary abstractions around after refactoring instead of proactively suggesting to remove them.