Remix.run Logo
maxbond 7 hours ago

You can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them.