There are world models such as Genie [0] which show that they can be constrained to games too.

[0] https://deepmind.google/discover/blog/genie-3-a-new-frontier...