Remix.run Logo
martythemaniak 2 hours ago

  > We use AI where semantic understanding and flexibility are useful, such as interpreting less structured information or understanding what in an unfamiliar scene is relevant to a procedure. Once the system knows what physical interaction it needs to perform, we prefer explicit geometry, planning, optimization, and control where possible. We're interested in the marriage between the two rather than trying to make every part of the robotics stack learned.
Congrats on the launch. I love this part, because it is also the working theory behind my robot clearing robot project (http://www.frost-e.com). I'm new to robotics, but it seems to me there's a gap between classic robotics tools and approaches (ROS2-based navigation, local YOLO-based object detection etc) and the video-input-to-actuator-output VLA models that robot labs are showcasing. In fact, I kinda think the big labs are trying to boil the ocean - long horizons, 6DoF actuator control, cross embodiment, generalization, etc etc.

Seems to me is that if you restrict the problem space, have well defined tasks, then marry the semantic understanding and reasoning of VLMs with the geometric tools of classical approaches, then you could have something practical and economical.