| ▲ | rererereferred 5 hours ago | |
I wonder if their very long words result in more or less token usage. | ||
| ▲ | amunozo 3 hours ago | parent | next [-] | |
Very long words in German are just compounds, made from individual words or morphemes. It is the same as in English if you remove spaces. Subtokens will be equivalent with or without examples. | ||
| ▲ | thenthenthen 4 hours ago | parent | prev [-] | |
This is an interesting question, Chinese is way more compact in Character count vs English (about 40%?), let alone german, but yeah.. Chinese makes up for it with… total character count that runs into the thousands… | ||