Self-racking lets you rack a bunch of gear you'd never find in VM/dedicated rentals, like consumer parts or older, still very good parts. Overclocking options are available as well if you DIY.

If you need single-threaded performance, colo is really the only way to go anyway.

We have two full racks and we're super happy with them.

▲

Melatonic 5 hours ago | parent [-]

Or under clocking and under volting for even better performance to price/power/longevity ratios

	▲	sroussey 4 hours ago \| parent \| next [-]
		For a single rack, you really don’t have too many choices for power. You make a choice to provision and pay, I never had anyone check how much of that I used and give me money back. Maybe things have changed though.
	▲	icelancer 5 hours ago \| parent \| prev [-]
		No doubt. Especially for GPU inference at scale. We overclock/overvolt for training and tune way down for inference.