> Aren't we still like a decade away from an Argon model being able to run on battery power for any reasonable amount of time that would fit on a robot that isn't the size of a school bus?

Sooner or later, the models will stop improving. After that happens, the best models will be etched into model-specific ASICs with weights fixed in mask ROM (like Taalas is already doing), which will result in massive, at least order of magnitude inference efficiency increase.

They said the same thing for transistor density in new chip nodes. It took 40 years of doubling every 2 years to finally hit a wall.

And although the industry hit a wall in density/area, they switched to scaling in 3D or glueing chiplets together. Moore's Law is still working if you change the definition to transistors/integrated circuit.

That doesn’t help the RAM situation