> But then how do you access the LLM provider? Etc.

You can expose an HTTP proxy over a vsock into the VM.

That sounds like more complex pieces of software that likely have security flaws and are easy to misconfigure.

This is the way.