I guess the vast majority of images have the palms the other way, that this biases the output. It's like how we misinterpret images to generate optical illusions, because we're expecting valid 3D structures (Escher's staircases, say).

Yes - it's the same reason generating a 5-leaf clover fails - massive amounts of training data that predisposes the model against it.