Remix.run Logo
Someone1234 11 hours ago

One thing I've noticed and HATE, is that when you increase thinking-effort, that seemingly increases response-length. Meaning that X.High is longer than High, which is longer than Medium, etc.

Which is kind of the inverse of how people work; a really smart person can condense difficult ideas into simple[r] terms. Whereas people who struggle speak a lot but say very little.

High/X.High do seem to deliver better quality results, but it sometimes feels like needle-in-haystack extracting that from the word vomit.

TeMPOraL 10 hours ago | parent | next [-]

With LLMs, you're still mostly read things "off the tip of the tongue". A better comparison is observing a smart person talking to themselves while working on a tough problem.

EDIT: also there's a reason the dial is called "effort", not "smarts".

skohan 9 hours ago | parent | next [-]

I don't think smart people generally solve problems by talking through reasoning steps at a mile a minute. They clear their mind and let the solution come.

Of course I don't know if there's really a way for this to be molded in current LLM's (sounds more like diffusion)

red75prime 6 hours ago | parent [-]

> They clear their mind and let the solution come.

They work on a problem until their brain is full of problem-related concepts. Then something comes. After validation it might be a solution.

adastra22 9 hours ago | parent | prev | next [-]

Yes, but that should apply to the CoT "thinking", not the final output.

apsurd 10 hours ago | parent | prev [-]

[dead]

alasano 10 hours ago | parent | prev | next [-]

It's so bad I've made myself a Pi extension that rewrites responses in side by side view using models on Cerebras (insanely fast tps)

fschuett 9 hours ago | parent | prev | next [-]

I just go over the comments with Gemini 3.1 Pro at the end which has a much more normal "voice" and it doesn't lose nuance as a cheap model would. I don't care so much about what Claude writes during the debugging as I just do all the cleanup at the end instead of at every commit.

wongarsu 10 hours ago | parent | prev | next [-]

The higher the effort the more things Claude checks, and it's eager to tell you about all of them

See, this insight it had early on looked like a red hering for a while, but then turned out to be load-bearing. And that's not just a difference in semantics, it changed the whole conclusion (spoiler: it didn't). And Claude is very eager to tell you about this exciting journey

Lucasoato 7 hours ago | parent | prev | next [-]

“I have made this letter longer only because I didn’t have the time to make it shorter.” - Blaise Pascal

ComputerGuru 10 hours ago | parent | prev | next [-]

OpenAI has separate dials for verbosity and reasoning_effort (but could still do a better job).

marcelo-earth 10 hours ago | parent | prev [-]

I hate this too, I had to switch to Codex, because the skill to force Claude Code not to think too much about very, very basic things no longer worked