Fortunately, the rockets for that will be helped along with the GPU capacity to run rocket simulations on. GPUs not being used to run LLMs can be used instead for physics simulations to help make those rockets work.

I'm looking at the second and third order effects of technologies. LLMs massively increase the surplus capacity of human civilization, and it is this surplus capacity enables resources (including human capital) to be expended on developing frontier technologies like rockets that can accelerate the development of space-faring capabilities.