If course what you're saying can be taking to absurdity too. Take the paradox of intolerance, if we let the intolerant have power they will wipe out anyone they don't like, hence why we have laws against things like murder.