First author here, surprised to see the paper in HN! :)

When doing the paper we noticed that models are very good at generating post-hoc plausible CoT, which to me knowledge can happen quite often with relatively easy tasks.

You might be interested in reading this other paper that came out after ours: https://arxiv.org/abs/2507.05246