Correct me if I'm wrong, but I thought everyone was still doing inference on the GPU for Apple silicon.

The Apple M series is SoC. The CPU, GPU, NPU, RAM are all part of the chip.

	▲	12 hours ago \| parent \| next [-]
		[deleted]
	▲	wtallis a day ago \| parent \| prev [-]
		The RAM is not part of the SoC. It's a bunch of separate commodity RAM dies packaged alongside the SoC.