Is there any evaluation of which right or which harm is larger? It seems like the idea that one outweighs another is arbitrary. Is there a principled thing behind it?

That's what the court is for. Weighing the different arguments and applying precedents