But the question is do you want to actually reward behavior that is just less bad than before? Or should that reward just be in the form of less punishment? I agree the consequences should get better in relative terms, but I don't think bad behavior should be rewarded with a positive response, even if the behavior is less bad than before.

It's like, if someone steals a million dollars and then steals a thousand dollars, you don't reward them for making progress.