I now wonder if we'll end up switching it all back to VMs so the LLMs have enough room to grow and adapt.

Maybe, but the install will often be done using a Docker file.