This is very nicely done. We have seen the same issue at a higher level of getting separators right when generating multiple files in a single inference call.

curious: wdym by "getting separators right when generating multiple files in a single inference call"

context: created hypertokens an even more robust hashing mechanism to create context-addressable memory (CAM), one cheat code is make them prefix-free, lots of others that get deep into why models work the way they do, etc.