Remix.run Logo
jcjohns 7 hours ago

It's an overloaded term that different people use for different things. At World Labs we think about three major categories of world models:

- Renderers output pixels or views of a world, either the real world or a generated world

- Simulators predict how the world responds to actions

- Planners predict actions for an agent to make to affect some change in the world

Under this taxonomy, Atlas is somewhere between renderer and simulator. It predicts high-quality views of a consistent 3D world (renderer) but it can also predict explicit 3D to aid in simulation. Atlas doesn't currently predict actions to directly drive a robot, so it isn't natively a planner; but its simulation abilities can help train another model to be planner.

Source: https://www.worldlabs.ai/blog/taxonomy-of-world-models