Sure, if the thing in question were someone being tried with a crime.

Rather, it's the opposite. It's not "punishing" police to say "hey, you can't use this evidence". That's not a punishment for them, they shouldn't personally be offended by that. And we certainly shouldn't be comparing that outcome to as if the police are being put behind bars.

We shouldn't be putting people behind bars with bad evidence just because we didn't know it was bad when we got it. No, we should retroactively say "hey, we can't use that evidence". If that hurts the police's fee fees I don't think that should come into play. I don't think that's a metric we should be optimizing for.