You can back-propagate through the CoT iterations or recurrent layers, same as you can back-propagate through normal intermediate layers.