> But even then AI can be used to recreate gameplay from video material..

Sorry what? Is there an example of AI recreating a nontrivial, modern game from just video material?

jjcm a day ago | parent | next [-]

Low complexity, but to test fable 5.2 I gave it this instagram reel of a Kikis delivery service inspired seedance video: https://www.instagram.com/reel/DXKjMSIkv97/?mdxt=OHBwaW5yamV...

And told it to make a game, and it made: https://petalwake.non.io

Vid is here if you prefer that: https://x.com/pwnies/status/2119987174884143348?s=46&t=bwJTI...

	▲	mjr00 a day ago \| parent [-]
		Yes, it can create a new game based on the style of a video, that's not really what anyone cares about though? The claim is that AI can recreate GTA6 from a GTA6 stream, not create an off-model GTA6 clone from video footage.

▲

hedora 2 days ago | parent | prev | next [-]

It's getting there. Most games are sitting on top of engines that do almost all the heavy lifting, so the AI just has to reverse engineer the assets, gameplay and levels from footage. It can even run the game alongside the clone to see what sort of differences it finds.

▲

mjr00 2 days ago | parent [-]

> Most games are sitting on top of engines that do almost all the heavy lifting

What? Yes, most game use engines, but all of them customize gameplay systems, graphics/shaders, UI, etc dramatically. That's like saying that most programs are easy to reverse engineer because Windows/Linux are doing almost all of the heavy lifting.

> so the AI just has to reverse engineer the assets, gameplay and levels from footage.

The word "just" is doing an incredible amount of lifting here, you're basically appealing to "AI is magic and will eventually be able to do everything". If that's your argument I can't dispute it I guess, but the fact is that at the current time there has not been an example of AI reverse engineering a modern video game from gameplay footage alone.

	▲	ipsum2 a day ago \| parent [-]
		Google's Genie and Dreamer models have 'reverse engineered' Minecraft and other games, but to a low fidelity so far. https://deepmind.google/models/genie/

▲

zamadatix a day ago | parent | prev [-]

I suppose this gets into world models a bit, but I honestly don't know this is a reasonable question. Do you really care to know it was already done or do you care to know if it could reasonably be done if it were the best available way? GP seems to be talking about the latter but you seem to be talking about the former.