Remix.run Logo
cruffle_duffle 5 days ago

Correct me if I’m wrong but in general that is just some json window dressing that gets serialized into plaintext and then into tokens…. There is nothing special about the roles and stuff… at least I think. Maybe they become “magic tokens” or “special tokens” but even then they aren’t hard fast rules.

koakuma-chan 5 days ago | parent [-]

They are special because models are trained to prioritize messages with role system over messages with role user.

jonplackett 2 hours ago | parent [-]

‘Prioritising’ an instruction is not the same as ‘following’ an instruction.