> Five months ago, we rebuilt our warehouse [1] on DuckDB instead of ClickHouse.

Why did they write this post if they had not even allowed things to settle. It sounds like someone wanted to claim victory (and promo?)

https://posthog.com/blog/why-we-rebuilt-our-data-warehouse

▲

crorella 3 hours ago | parent | next [-]

The intro to that post is so bad: "PostHog's original data warehouse had a single goal: delay the moment a company needs to hire their first data engineer."

It is not to serve high quality and timely data to make good decisions, is to avoid hiring a specific role, lol. So bad.

	▲	ecshafer 2 hours ago \| parent [-]
		Ironically a good data engineer should probably let them avoid needing 3 different data warehouse systems within a year.

▲

roboben 28 minutes ago | parent | prev | next [-]

Author here. I admit I kinda left out the context which is important here. We did not replace Clickhouse. Instead we want to move our warehouse product from Clickhouse to another stack which suits the long modeling jobs and multi-tenancy better. We learned through all our early design partners running huge workloads what we need to change.

As much as I'd love to claim victory, we are not there yet :)

▲

wheelerwj 3 hours ago | parent | prev | next [-]

Engineers like to experiment and we get the benefit of learning from their experiences. Not sure why you’re upset.

▲

ambicapter 2 hours ago | parent | next [-]

Maybe it's the "me first" mindset you're bringing to engineering?

▲

ams92 43 minutes ago | parent | prev | next [-]

This sounds more like a 5 month POC that the engineer should have been able to prove sooner that DucksDB didn’t fit the use case.

	▲	roboben 26 minutes ago \| parent [-]
		Author here. We went past the POC stage to actually make real customer workloads work, which we did. Probably yes, we spent too much time not rethinking our approach but sunken cost fallacy so that's why.

▲

weego 3 hours ago | parent | prev | next [-]

I mean, mostly it just comes off as egregious self-indulgence to try one thing and then jump to "we built the solution ourselves!" when the problem is not novel at all. These things are just tiresome.

▲

antonvs 32 minutes ago | parent | prev [-]

> Engineers like to experiment

The job of management is to help manage that. Typically, the desire to experiment is constrained to lab environments and so on. Experimenting on your actual users carries a lot of risks - to product stability, customer relations, market perception, etc.

▲

dcrazy an hour ago | parent | prev [-]

This is the same company with intentionally annoying full-wrap bus ads on Muni. They are trying to capture mindshare.