> But why would we do that? Why would we hook up an LLM to a robot factory, or make an ASI that could easily move itself into the ether?

The venture capitalist world is full of people who will deliberately ruin a company based on the extremely unlikely but possible scenario where the companies goes to the moon in value. I think there's pretty much 100% certainty that multiple venture capitalists are going to try exactly what you're suggesting on the off chance that it makes them the new world controller.