| ▲ | srean 2 hours ago | |
I do not know inner details of Zstandard, but I would expect that it to least do suffix/prefix stats or word fragment stats, not just words and phrases. | ||
| ▲ | duskwuff 22 minutes ago | parent [-] | |
It's not specifically aware of the syntax - it'll match any repeated substrings. That just happens to usually end up meaning words and phrases in English text. | ||