The article is dumb, "why do you have an API endpoint that deletes your entire production database?" irrelevant, the AI did what it did, period.

▲

Avicebron 5 hours ago | parent | next [-]

Uh?

If someone left a loaded gun in a room and then let a toddler run around in it, we would be questioning why the guy 1) left the gun in the room 2) left the toddler in the room unsupervised. We wouldn't be saying, well no one should have toddlers in rooms.

▲

bux93 5 hours ago | parent [-]

A PhD-level toddler, mind you.

	▲	kennywinker 4 hours ago \| parent [-]
		Lol no. No LLM that exists today can write a legible PhD thesis. Nor a masters dissertation. Maybe a first-year collage student, if we’re being generous, but I wouldn’t leave one of those in a room with a loaded gun either.

▲

mock-possum 5 hours ago | parent | prev [-]

No, the AI did what you told it to do. The AI didn’t do anything on its own.

> if you're going to use AI extensively, build a process where competent developers use it as a tool to augment their work, not a way to avoid accountability

	▲	BadBadJellyBean 4 hours ago \| parent [-]
		> No, the AI did what you told it to do. I'd say yes and no. The LLM reacted to the input that was given but it is not possible for a human (especially without access to the weights) to even guess what will happen after that. Regardless of that I agree that it's completely the fault of the user to use a tool where you can't predict the outcome and give it such broad permissions and not having a solid backup strategy. Either don't use non deterministic tools or protect yourself from the potential fallout.