LLMs can already control robots. Today's LLMs are inept at it, but they can do it.

Things will be bad, unless someone does something to stop it. Will anyone do that? We don't know.

https://xkcd.com/2278/