Remix.run Logo
claudeomusic 2 days ago

Can someone dumb this down a bit for a non data-engineer? Hard to fully wrap my head around who this is/isn’t best suited for.

lysecret 2 days ago | parent [-]

One usecase we have (we built it ourselves) is to periodically offload data from Postgres to lake house partitioned data on GCS. The way I see it this can now be done with a single query. Another one is the other way around to use posters as a query engine or to merge offloaded data with your live data.

claudeomusic 2 days ago | parent [-]

What services do people primarily use to accomplish these tasks today? All custom work?