My take was that the information is stored in the ordering of the files. The decompressor doesn't care about the file size of each file, right?

Both are needed. If you want to transmit this solution from one computer to another you need to store the size of each file (or insert a fancy delimiter that takes even more space).