Remix.run Logo
▲ numpad0 23 minutes ago

Aren't tokenizers a hack to turn Latin alphabet texts into a pseudo Chinese with better per-unit information density?