Remix.run Logo
▲ ben_w 2 hours ago

Are bytes relevant? These things are billed by the megatoken, not the megabyte.

▲paulryanrogers an hour ago | parent [-]

If tokens use UTF-8 bytes then it could be a factor.

▲ben_w an hour ago | parent [-]

A token is an index into a dictionary. What the dictionary uses isn't seen, this is why they couldn't count the 'r's in 'strawberry'.