Doesn't this fit the real world, though?

I'm Australian. We drop the C-bomb regularly. Other folks flinch at it. Presumably the vast corpus of training data harvested from the internet includes this flinch, doesn't it?

If the model dropped the C-bomb as regularly as an Australian then we'd conclude that there was some bias in the training data, right?