If you get any accuracy degradation with full 8 bits of precision you're doing it wrong.

Or your model wasn't trained so well (weights are too spiky)