| ▲ | nekusar 3 hours ago | |
When the comparison is again 128 H100's , yeah, this is a crazy good upgrade. And you can rent H100's and H200s for not that much per hour. | ||
| ▲ | p_stuart82 an hour ago | parent | next [-] | |
$2-4/hr always sounds cheap until you multiply by wall clock and reruns | ||
| ▲ | jeremyjh an hour ago | parent | prev [-] | |
Yes but they are getting only 341 tok/s. A 2.5 trillion run would take over 200 years. | ||