Nice analysis. The simplicity of this indicates that it should be happening during training via regularization.
it could happen post training as well. the direction u is arbitrary, it could mean looping, it could mean more thorough reasoning.