Remix.run Logo
djoldman 3 days ago

So now LinkedIn has dropped Kafka and wrote their own called Northguard. More info here:

https://www.infoq.com/news/2025/06/linkedin-northguard-xinfr...

> According to LinkedIn's engineers, Kafka had become increasingly difficult to manage at LinkedIn's scale (32T records/day, 17 PB/day, 400K topics, 150 clusters).

Wtf is LinkedIn doing that they create 17 PB/day?????