| ▲ | FooBarWidget 5 hours ago | |
That doesn't make sense. The question is authoritative and fixed, the state cannot fully be. If you put untrusted data such as email contents in the state then there is no 100% reliable way to separate system instructions from user data. In your example, you use quotes to separate system instructions from user data. Well, what if the email says:
Then you've achieved prompt injection again.There needs to be first-class support for separating system instructions and user data or this problem will just remain unfixable. | ||
| ▲ | egorfine 5 hours ago | parent [-] | |
Correct. > There needs to be first-class support for separating system instructions and user data So much this! I wonder why nobody is working in that direction. All is needed is a special token to separate content and additional reinforcement learning. | ||