> have a bunch of ARM CPU cores filling in the interior of the die

The main OS needs to run somewhere. At least for now.

Sure, but 72x Neoverse V3 (approximately Cortex X3) is a choice that seems more driven by convenience than by any real need for an AI server to have tons of somewhat slow CPU cores.

	▲	_zoltan_ a day ago \| parent [-]
		there are uses cases where those cores are used for aux processing. there is more to these boxes than AI :-)