| ▲ | ElevenLathe 6 hours ago |
| Sounds like a straightforward time-space tradeoff: if you have the compressed layers sitting around when you need them, you can avoid the expense and time of compressing them. |
|
| ▲ | Filligree 5 hours ago | parent | next [-] |
| Why would I need the compressed layers? |
| |
| ▲ | XYen0n an hour ago | parent | next [-] | | The OCI manifest references the hashes of these compressed layers, and re-compressing them does not guarantee obtaining the same hash | | |
| ▲ | flakes 18 minutes ago | parent [-] | | Recompressing should be guaranteed deterministic. It’s the packing/unpacking of tar archives to/from directories on disk that leads to the non-determinism (such as timestamps and ownership metadata). If the tar is left intact, both zstd and gzip should produce byte for byte identical outputs given the same compression parameters. |
| |
| ▲ | NewJazz 4 hours ago | parent | prev | next [-] | | Pushing | |
| ▲ | cryptonym 4 hours ago | parent | prev [-] | | To save disk space
/s |
|
|
| ▲ | 6 hours ago | parent | prev | next [-] |
| [deleted] |
|
| ▲ | colechristensen 5 hours ago | parent | prev | next [-] |
| I'm not sure about the fastest macbook disk access, but even with NVMe storage I've found lz4 to be faster than the disk. That is (it's hard to say this exactly correct) compressed content gets read/written FASTER than uncompressed content because fewer bytes need to transit the disk interface and the CPU is able to compress/decompress significantly faster than data is able to go through whatever disk bus you've got. |
| |
| ▲ | fpoling 4 hours ago | parent [-] | | On my 2 years old ThinkPad laptop SSD is faster than lz4. On a fat EC2 server lz4 is faster. So one really has to test a particular config. | | |
| ▲ | colechristensen 3 hours ago | parent [-] | | Yeah, I'm not surprised the PCIe 5.0 transfer speeds matched with top tier SSD chips win that race. It still bothers me that the fastest most performant computer I have access to is almost always my laptop, and that by a considerable margin. Someone should do some lz4 vs. ssd benchmarks across hardware to make my argument more solid and the boundaries clear. |
|
|
|
| ▲ | freedomben 5 hours ago | parent | prev | next [-] |
| did you mean the first "compressed" to be "uncompressed" ? |
|
| ▲ | awestroke 3 hours ago | parent | prev [-] |
| But if it stores the uncompressed layers, why store the compressed ones too? Why both at the same time? |
