| ▲ | simonw 15 hours ago | |
One interesting feature of DuckDB is that it can run queries against HTTP ranges of a static file hosted via HTTPS, and there's an official WebAssembly build of it that can do that same trick. So you can dump e.g. all of Hacker News in a single multi-GB Parquet file somewhere and build a client-side JavaScript application that can run queries against that without having to fetch the whole thing. You can run searches on https://lil.law.harvard.edu/data-gov-archive/ and watch the network panel to see DuckDB in action. | ||
| ▲ | keepamovin 6 hours ago | parent [-] | |
In that case, then using duckdb might be even more performant than using what we’re doing here. It would be an interesting experiment to add the duckdb hackend | ||