| ▲ | rahimnathwani 5 hours ago | |
Can anyone explain how this is possible?
Does this means the instructions are no longer just something in the early part of the conversation? (If they were, changing them would invalidate the KV cache. no?) | ||
| ▲ | 2001zhaozhao 3 hours ago | parent | next [-] | |
Perhaps they trained it with a new special system instruction token that is specifically trained to produce the same result as changing the system prompt, but is inserted into the prompt mid-conversation? | ||
| ▲ | pornel 3 hours ago | parent | prev [-] | |
The commands they list are app management, not part of LLM context. It's a bugfix for a needlessly delayed UI, not a model capability. | ||