This is very good. Super snappy and gives me what I'm looking for. Great write-up too.

How much more would it cost to use a multilingual tokeniser? I realise this is somewhat pointless for an English blog, but services like Uber Eats have something like that going on (server-side of course, and they may just be translating queries).

It’s gets much larger (there’s the potion-multilingual-128M model, distilled from bge-m3 which has like 100 languages), so it gets to ~120m range for the lookup table (4x smaller if you’d do int8 quantization, so you could get to to 30-35mb).