> It is as related to "Agentic $whatever" as your toaster is related to it

These things have hardware FP8 support, and a 1.8TB/s full mesh interconnect between CPUs and GPUs. We can argue about the "agentic" bit, but those are features that don't really matter for any workload other than AI.

▲

pezezin 4 hours ago | parent | next [-]

The huge interconnect would also useful be for HPC tasks. The FP8 not so much, HPC still loves FP64.

▲

kibibu 5 hours ago | parent | prev | next [-]

Would cloud gaming platforms benefit from the interconnect?

	▲	pdpi 5 hours ago \| parent [-]
		Don't think they would. Games aren't nearly as hungry for memory bandwidth as LLMs are. Also, I expect that the VRAM/GPU/CPU balance would be completely out of whack. Something would be twiddling its thumbs waiting for the rest of the hardware.

▲

dmitrygr 5 hours ago | parent | prev [-]

mem bw between cores matters for .... literally all workloads that are not single-core (read: all). And FP8 matters not at all cause inference on cpu is too slow to be of any use whatsoever in the days of proper accelerators