| ▲ | whizzter a day ago |
| Yeah, cooling AND underclocking will probably be required to somewhat safely operate these. That said, 80G for something that you picked up for cheap could be an absolute steal these days. |
|
| ▲ | roger_ a day ago | parent [-] |
| No need for underclocking, though power limiting doesn't sacrifice much performance. Currently listening to the soothing drone of my $200 Octominer cooling my cards while I'm fine tuning a model (almost makes a good space heater). |
| |
| ▲ | segmondy a day ago | parent [-] | | I run mine in octominer too, with fan control too. No noise, did fine during the winter with heat and it's very comforting as we enter winter. https://www.reddit.com/r/LocalLLaMA/comments/1wjr59t/768gb_v... | | |
| ▲ | roger_ a day ago | parent [-] | | Yeah the fan noise is only noticeable when I push the cards to ~180W, otherwise they idle pretty quiet. How are you dealing with the RAM limit (32GB)? I had upgraded mine to an i7 but it was unstable so I’m back to the stock Celeron class CPU. | | |
| ▲ | segmondy 21 hours ago | parent [-] | | I'm not using octominer MB or CPU. That MB on my octominer case is running everything, it's an epyc cpu with 512gb of dram. octominer is also pcie limited, i get faster pcie lane with this. |
|
|
|
