> What if I specifically tell it to not do anything nefarious or illegal?

Sure, but a reasonable user would expect that condition to be implicit in using a commercial model.

It’s what the safety/alignment discussion is about: how we can get models to actually comply with laws & ethics.

But the same problem exists in the real world. If you tell someone to “Try everything possible to get it done, I don’t care what it takes”, I’d imagine that people would be far more likely to bend/break rules than if you said “could you please help me with… ?”

Do agents know exactly what jurisdiction I am in and which national, state, and local laws apply to me?

> Sure, but a reasonable user would expect that condition to be implicit in using a commercial model.

In fact, adding it might make things worse as it shows at least some awareness of the risks.