> Why is it not part of the punishment?

Indeed it is part of the punishment. As an earlier comment in this thread points out from the 13th amendment:

> "Neither slavery nor involuntary servitude, except as a punishment for crime" (emphasis added by me)