| ▲ | ofalkaed 3 hours ago | |
>it’s Cantrill and Gregg screaming at Thumpers and affecting IOPS. For me, that is less meaningful and more random than a youtube link. I have absolutely no clue what you are talking about. | ||
| ▲ | neomantra 35 minutes ago | parent [-] | |
That is fair, particularly compared to Janet Jackson! I will add detail. In their younger days, two distinguished engineers, Bryan Cantrill and Brendan Gregg, made this video where they scream at a data storage server nicknamed Thumper. Screaming at it has surprising results, which are observed with a novel software technology called dtrace. The Sun Fire X4500 was a dense storage sever, 4U with 48 disks and insane IO performance and a newish filesystem called ZFS. The video is not only funny in content, it features technology and technologists that became very impactful, hence the classic tag. --- I love the lore, so I'll drop more. While our team previously used AFS (mainly for its great caching) and many storage servers, this hardware combined with its software allowed us to consolidate and manage and access data in new ways, alleviating many of our market data analysis problems. We switched to NFS, which previously was not performant enough for us on other hw/sw architectures. While using NFS with the Thumpers and then Thors (X4540) was fantastic, eventually the data scales became hard again and we made a distributed immutable filesystem that looked like the Hadoop HDFS and Cassandra file systems, named after our favorite Klingon Worf (Write-Once Read-Frequently). Interestingly, in 2025 both XTX [1] and HRT [2] open-sourced their distributed file systems which are pretty similar to it, using 2020's tech rather than 2000's. HRT's is based on Meta's Tectonic which is a spiritual successor to Cassandra. I wrote about our parallel HFT networking journey once upon a time on HN. [3] [1] https://www.xtxmarkets.com/tech/2025-ternfs/ [2] https://www.hudsonrivertrading.com/hrtbeat/distributed-files... | ||