Remix.run Logo
CardenB an hour ago

AFAIK NVidia has a VLA running on their chips with 2B params at 10Hz. They’ve openly published a .5B model running at 10Hz

YuechenLi 28 minutes ago | parent [-]

10Hz is still a 0.1s of latency, which doesn't seem like a lot until you realize that an Arduino typically runs at 16 Mhz, which is literally a million times faster than running a full LLM.

So, yeah, for complex reasoning and sensory processing, LLMs are the correct choice, and Gemini is especially strong at spatial reasoning over ChatGPT/Claude. But for actual motion/actuation? LLMs are the wrong tool for the job, probably easier to have LLMs program a reusable workflow in a script for repeated tasks instead of invoking LLMs after the first time.

CardenB 21 minutes ago | parent [-]

For this operating domain the latency comparison is human reaction time and not arduino reaction time.

Also the process that’s running at 16MHz is not the same as a full VLA. VLA is much more expressive. You think the processor that is running the VLA system is running at 10Hz or some GHz?