> The measured entropy of the model remains nearly unchanged though which means we have lost capabilities

Or we've lost random noise, or redundancy not captured by the entropy measurement.