Because nobody knows what they're doing, everything is a heuristic learned by another (simpler) AI whose job is to guess how humans would rate responses.

There are regular attempts to force regularity between human categories, have the AI treat everyone the same. One of the failures I remember of that, a few years back, generating images of WW2 german soldiers would evenly mix in every race including the victims.