Remix.run Logo
vessenes 5 hours ago

Really interesting. Upshot: a well trained multimodal video generation model has a world representation model trained inside it. They’ve done some work lifting this world model out and deploying it to robots, where it seems to work well.

On the one hand, this isn’t a new idea, and the quality video models certainly have understanding of materials, light, the world (at least in an Occam’s razor sense of understanding). I’m not aware of a video lab that’s turned itself into a robot lab yet, though; perhaps this would be a first, or a new sort of obvious-in-retrospect business path: train video model, sell video generation, scale, use scale to train robot things: profit.

I found their hands very interesting - looks like a bunch of stuff hidden in gloves - Xiami’s Robotics-1 foundation model just released videos of users training on some pretty standard looking grippers; to the point that there are demo videos of people putting on gripper type gloves to make video to train that model.

The BFL model looks like it doesn’t need that at all. Given the difficulty of the hardware side, I’ll be curious to see what they do with this.

mike_hearn 3 hours ago | parent | next [-]

I think this tactic is standard, no? Nvidia has demoed robots being trained using video generation models, and Waymo has been doing that for a while too.

https://waymo.com/blog/2026/02/the-waymo-world-model-a-new-f...

lairv 2 hours ago | parent | prev [-]

FYI several other video labs are getting into robotics

Luma Labs https://lumalabs.ai/news/luma-open-physical-ai-lab

Runway https://runway.com/product/robotics