I was handwaving around the exception for criminals, but I concede your point: it's an oversimplification to say slavery is strictly illegal.

(One can also make some interesting arguments around the notion of the draft).