> Unfortunately it seems like we can't assume we can "box" the AI (e.g., deny it connection to the Internet) and expect that to last

Of course we can do that. It's not an eternal being of light existing on the astral plane, but some code executing on someone's GPU.

It stops existing once you press Ctrl + C