I don't think you're just lucky, depends heavily on the model + reasoning effort. I've never had any of the GPT models do anything of the sorts when using the higher reasoning efforts, but sometimes when I play around with local models, even "big" ones (as big as you can fit with 96GB VRAM) sometimes forgets/misses to define $ID then do "rm -rf data/$ID" for example, deleting more than they intended.

▲

Muromec 2 hours ago | parent [-]

>sometimes forgets/misses to define $ID then do "rm -rf data/$ID"

Right, that's kinda the same failure mode as delete from table something and hitting enter before you write the condition or writing the wrong one. If you reach the point where you opened the terminal to do it this way you already lost.

	▲	embedding-shape an hour ago \| parent [-]
		> If you reach the point where you opened the terminal to do it this way you already lost. I'm not sure what this means, the model and agent harness is the ones "opening the terminal and running this" (via a exec_shell tool or whatever), they do mistakes like this sometimes. Sometimes the scope is bigger, sometimes less, but anything below SOTA + higher reasoning efforts seems to fall into these mistakes sometimes.