I concur it's bad at directly visual concepts, your prompt is akin to the svg pelican. What I do is asking him for procedural algos, automatas, quadtrees, layered noises, and rig those into the game. Yes, it can't "make the next gta", but with a reasonable scope and knowing what it does best, it has been very easy for me to produce satisfying results.

My problem is I don't really have video game engineering experience. I was going off a concept that a different AI nailed with video creation and was trying to replicate it in the game engine.

Would you care to show a few pictures?