> simulator the model builds is comparable to the mental model of the game humans create

>if you have the model simulate them they become trivial

Eh, this is kind of sounds like being a prey animal that develops an almost unbeatable colored camouflage and then the predator develops infrared vision making it useless and the prey saying "no fair, you cheated".

People use algorithmic models all the time on problems that are far too difficult or large for their minds to conceptualize, is this not just an extension of that?