Remix.run Logo
hungryhobbit 14 hours ago

Amen. I would trade some stupidity (say ten points on any benchmark) in exchange for a version of Opus or a similar model that actually gave me direct, concise answers.

pdntspa 14 hours ago | parent | next [-]

You should try setting claude code to opus 4.6. With the style instructions I set in my user CLAUDE.md it does exactly that. It's like night and day: Opus 5 gave me a page and a half of word-vomit, yet the exact same task and prompt with 4.6 and I got maybe 100-150 words total, entirely readable.

trueno 13 hours ago | parent [-]

x2 on opus 4.6. still works great, and it's fast. opus 4.6 is where i hope local llm's get to someday, that's kind of my personal benchmark for where "local is more than good enough i dont need these idiot large-scale service providers"

atishaykumar 14 hours ago | parent | prev [-]

You can possibly give instructions on how to respond to your questions.

hungryhobbit 14 hours ago | parent [-]

Yes, and they will work ... for like two turns, after which Claude will go back to its usual wall of text.

And yes you could add context (memories, rules, CLAUDE.md entries, etc.): they won't help (for long). Same for hooks that remind Claude to be concise: it gets "attenuated" and starts ignoring any such instructions quickly. There's also writing guidelines ... but they're basically just more context with slightly higher weights (ie. Claude will still ignore them).

I've even gone so far as to make a hook that identifies long responses and requests shorter versions (which is challenging in itself, as you need to run another lower-powered model to evaluate how long is "too long", as what's "long" when the expected answer is one line is different from what's expected for a ten line answer). However, that just shows you the long version, then some hook text, then (10-15 seconds later) it shows the short version. So I created a proxy that hid the long version/hook text for me ... but I had to abandon it because all that used up so much usage I was running out.

I'm fuzzy on the details, but Caveman somehow "hacks" Claude in a way that gets past all that ... but it takes things too far in that direction, with "cave man" speech that sucks.