Remix.run Logo
▲ snapetom 2 hours ago

Is this basically a table format like Delta/Iceberg but with an SQL engine built in via DuckDB?

▲Lucasoato an hour ago | parent [-]

Nope, from my understanding the delta log (the files that say which of your data files are actually valid or not) isn’t saved in json/parquet but directly in a database.

Much faster, but adds a dependency... that you would have added anyway with database based catalogs (that are not the only kind of catalogs)