Remix.run Logo
wongarsu a day ago

Almost none of the hosted models give you their unredacted CoT. Claude certainly doesn't, what you get are fragments and summaries from it.

There are various justifications on this, but it's mostly to make distillation and fine tuning off their model outputs a bit harder for their competitors

aabhay a day ago | parent [-]

Its also because the CoT is probably unintelligible

optimalsolver a day ago | parent [-]

More legible than seems at first glance:

https://www.lesswrong.com/posts/wCSEpT3dTGz4N86Wi/even-illeg...

orbital-decay 5 hours ago | parent [-]

The text can be legible, but the meaning the model assigns to these words can be subtly different, and you have no way to tell. This is evident when trying to make most modern reasoning models follow a fixed CoT plan by filling a form with placeholders, they're extremely stubborn because they simply don't understand your words in it! They learned their own language in their CoT. Sometimes they're controlled for readability during training but even then they find a way to circumvent this, for example Gemini 3.0 had perfectly readable raw CoT but was barely able to follow such a plan (3.5 Flash is way better at following, they clearly improved it).