With a handy trick called arithmetic coding, you can actually turn an LLM into a lossless compression algorithm!
Indeed, see https://bellard.org/nncp/ for an example.