| ▲ | yung_lean 4 hours ago | |
A big problem with parquet, which this aims to replace, is that it's hard to add new encodings because everyone wants to stay compatible with old readers. Embedding the decoders in the file as WASM solves this problem since in theory, old readers will be able to read new files by just using the provided WASM to decode a column whose format the reader doesn't recognize. So this is really about making a file that is forwards compatible in a way that lets you push the standards more than existing formats. | ||