| ▲ | anentropic 12 hours ago | |
I am curious about this use case How do you see it helping with DuckLake? | ||
| ▲ | arpinum 5 hours ago | parent [-] | |
Latency, predicate pushdown. Pre-compaction the recent data can be in small files, and the delete markers will also be in small files. This will bring down fetch times, while ducklake may have many of the larger blocks in memory or disk cache already. Reading block headers for filtering is lots of small ranges, this could speed it up by 10x. | ||