LLMs do not reason at all (i.e. deductive reasoning using a formal system). Chain of thought etc simulate reasoning by smoothing out the path to target tokens by adding shorter stops on the way.

Do you reason? "LLMs do not reason at all" casts that into doubt immediately.