| ▲ | theultdev 7 days ago | ||||||||||||||||
R2 is S3 compatible with no egress fees. Cloudflare actually has built in iceberg support for R2 buckets. It's quite nice. Combine that with their pipelines it's a simple http request to ingest, then just point duckdb to the iceberg enabled R2 bucket to analyze. | |||||||||||||||||
| ▲ | 8organicbits 7 days ago | parent | next [-] | ||||||||||||||||
> R2 is S3 compatible with no egress fees. There's no egress data transfer fees, but you still pay for the GET request operations. Lots of little range requests can add up quick. | |||||||||||||||||
| |||||||||||||||||
| ▲ | apwheele 7 days ago | parent | prev | next [-] | ||||||||||||||||
For a demo of this (although not sure with duckdb wasm that it works with iceberg) https://andrewpwheeler.com/2025/06/29/using-duckdb-wasm-clou... | |||||||||||||||||
| ▲ | greatNespresso 7 days ago | parent | prev [-] | ||||||||||||||||
Was about to jump in to say the same thing. R2 is a much cheaper alternative to S3 that just works and I have used it with DuckDB, works smoothly | |||||||||||||||||