| ▲ | snapetom 2 hours ago | |
Is this basically a table format like Delta/Iceberg but with an SQL engine built in via DuckDB? | ||
| ▲ | Lucasoato an hour ago | parent [-] | |
Nope, from my understanding the delta log (the files that say which of your data files are actually valid or not) isn’t saved in json/parquet but directly in a database. Much faster, but adds a dependency... that you would have added anyway with database based catalogs (that are not the only kind of catalogs) | ||