spacial context feature is cool - what are the limitations, if any? What would it take to geo and rotation tag every photo ever taken , combine it into a mass spatial context, run it through atlas and build an entire 3D model of the world?

▲

keunhong 8 hours ago | parent | next [-]

Atlas project lead here.

Atlas is an auto-regressive diffusion model, so context length limitations apply similar to LLMs and video models.

Where Atlas has an edge is that its context comprised of an arbitrary sequence of images with camera poses, which lends itself to managing the context in creative ways (we called this "context juggling" in our RTFM blog, https://www.worldlabs.ai/blog/rtfm). So yes through clever context management you could potentially build an entire 3D model of the world.

▲

cman1444 5 hours ago | parent | next [-]

Would it be more reasonable to take images from movies and create worlds of various IPs?

My first thought is a detailed Hogwarts that is fully explorable using scenes from the movies (or even descriptions from the books?)

▲

stranded-man 8 hours ago | parent | prev [-]

can atlas also generate 3D without pose information attached to the input images?

	▲	jcjohns 8 hours ago \| parent [-]
		Yes, as long as the input images are "poseable" -- if they were taken in the same space they need to have some overlap, where the same object or part of the scene is visible in multiple views so the pose can be predicted. You can also manually position the input images in 3D space to create scenes generatively; we show examples of this in the "generating with spatial context" section

▲

8 hours ago | parent | prev [-]

[deleted]