> H200 GPU with 1.5TB host memory,

While yes it's one GPU.. It's not exactly a slim one.

nekusar 3 hours ago | parent | next [-]

When the comparison is again 128 H100's , yeah, this is a crazy good upgrade.

And you can rent H100's and H200s for not that much per hour.

	▲	p_stuart82 an hour ago \| parent \| next [-]
		$2-4/hr always sounds cheap until you multiply by wall clock and reruns
	▲	jeremyjh an hour ago \| parent \| prev [-]
		Yes but they are getting only 341 tok/s. A 2.5 trillion run would take over 200 years.

>cries in RTX 3060