They could just make sentencing tougher and keep criminals in prison.

The strongest predictor (by far) for committing a crime is having a prior criminal record.

Don't you think that isolating people in poor conditions amongst hardened criminals might make them more likely to commit crime when they get released?