Self-plug I have a very similar blog post title but a very different approach. Honestly, I like your idea more than my own idea. https://nostalgia.dev/posts/running-doom-inside-a-transforme...

what if you run doom on doomformer?

I havent fully recursed but what I have done with this is use a DOOMformer to generate a level, have python compile it, have DOOMformer generate the name of the level, and use a DOOMformer brain to complete said level. I have also trained said DOOMformer (you can see the levels "weights" updating as it trains) to aim better lol