It would be really funny if Anthropic engs run open weight models locally when they need to fix Claude API issues :)

Or just their own models locally, since 8x GPU pods fit under a desk (makes a nice foot heater too)

It's been a while since I messed with serious hardware, what's the cooling noise level? I guess they have to be water cooled or the rack format 8u ones would be about 100db

▲

27183 15 hours ago | parent [-]

My 4x 15k rpm 1U fans I use to cool my twin AMD V620s make a horrible racket, especially how they resonate with the rest of the workstation's case fans. Similar in volume and annoyance to running an 8" circular saw. I can only imagine it would probably be as bad or worse than that.

▲

jaggederest 12 hours ago | parent [-]

Yeah my experience in the past was that datacenter hardware (air cooled, at least, I've never dealt with water cooled) uses tiny fans at or about 15000RPM, so it matches basically what you're saying or worse.

I always loved this video: https://www.youtube.com/watch?v=tDacjrSCeq4

	▲	27183 6 hours ago \| parent [-]
		That was one of those fantastic early google videos/youtube things I probably watched 100 times. This was another from (roughly) that era: https://www.youtube.com/watch?v=ULSA5wktywI