Remix.run Logo
inglor 2 days ago

This is really nice though looking at the code - a lot of the postgres types are missing as well a lot of the newer parquet logical types - but this is a great start and a nice use of FDW.

pgguru 2 days ago | parent | next [-]

Hi, what types are you expecting to see that aren't supported? I believe we had support for most/all builtin postgres types.

inglor a day ago | parent [-]

Postgres has like 300+ types but mostly stuff like decimals should work the same way it does with Postgres (with the edge cases like NaN existing in Postgres but not parquets accordingly)

mslot a day ago | parent [-]

In principle, Postgres has an infinite number of possible types :).

pg_lake maps types into their Parquet equivalent and otherwise stores as text representation, there are a few limitations like very large numerics.

https://github.com/Snowflake-Labs/pg_lake/blob/main/docs/ice...

inglor 2 days ago | parent | prev [-]

Also, any planned support for more catalogs?

pgguru 2 days ago | parent [-]

I think we have recently merged (or are getting ready to merge) REST catalog support, so that will open some things up in this department.