Remix.run Logo
XenophileJKO 20 hours ago

There is a huge overhang. Same techniques and sometimes even the same models can drive a lot of robotics coordination and decision making.

Here is probably one of the more clear examples. A model trained on video and also robotic simulation/recording (probably ensembled with control systems/mobility models) will likely be at the core of how robots make decisions and plan.

https://deepmind.google/blog/gemini-robotics-2-brings-whole-...

This is way outside my area of expertise though. I've only dabbled in more classic robotics and control systems, but these multi-modal sequence to sequence models are highly adaptive and can effectively transfer learning across very different domains.