> How do you derive that something is "below average" or "average" or "above average"?

One technique is RLHF: have an human expert assess it.