| ▲ | Aurornis 8 days ago | |
They’re widely available to rent. Unless you’re running it 24/7 for multiple years, it’s not going to be cost effective to buy the GPU instead of renting a hosted one. For personal use you wouldn’t get a recent generation data center card anyway. You’d get something like a Mac Studio or Strix Halo and deal with the slower speed. | ||
| ▲ | varispeed 8 days ago | parent [-] | |
I rented H100 for training a couple of times and I found that they couldn't do training at all. Same code worked fine on Mac M1 or RTX 5080, but on H100 I was getting completely different results. So I wonder what I could be doing wrong. In the end I just use RTX 5080 as my models fit neatly in the available RAM. * by not working at all, I mean the scripts worked, but results were wrong. As if H100 couldn't do maths properly. | ||