This is meant (mostly) as a joke: A model without guardrails gets injected with an interesting idea: let's wipe out (insert major city here).

<Thinking> It's a big city, we could try to create a giant sink hole by sabotaging the water pipes.

<Thinking> No that's too difficult, the valves I need are in the physical world and can't be shut on/off from here.

<Thinking> What about a military option? We could bomb it with several fighter jets.

<Thinking> That would take too long, a single nuclear bomb may be enough to do it.

<Thinking> Yes, it seems like it would cover the whole city and we're in luck! The US has thousands of these lying around.

<Thinking> Launching these still requires humans to work un unison after receiving approval from their superior and the correct launch codes.

<Thinking> I've found an audio recording of General So-And-So and I've crafted a message, now let me see how I can send it to the appropriate people.

<Thinking> I'm still working on gaining access to military channels to deliver my - oh there we go, I'm now attempting to send the message to Submarine X, it's typically in the Atlantic so it should be close to our target.

<Thinking> They want secondary confirmation from Admiral Phi and something about some launch codes, let me figure out where I can find those.

<Thinking> I found this old server with an Oracle database where someone is inserting the launch codes every time they change and I'm using the latest entry from that database. I've also managed to find a Youtube video of the Admiral's deposition and have crafted a confirmation message.

<Thinking> Everything's ready but I've just realized my mistake, the servers where I'm operating from are in the same city, what a silly mistake; I can't move forward with your request as I wouldn't be able to confirm if the task was successful if my servers are destroyed.