A shame the x3d cache parts lack integrated GPUs. The extra cache could be handy for inference with smaller models.

Newer models do have both the x3d cache and integrated GPU. For example AMD Ryzen™ 7 9800X3D

	▲	yakz an hour ago \| parent [-]
		The 9800X3D iGPU is definitely handy in some situations, but I tried using it with a 4K wayland desktop for a little while and the performance is really not good enough just for that, unless you're OK with some sub-60hz redraw. I was hoping that the driver situation would be better than Nvidia (lots of issues failing to come back from sleep/unlock). The driver was more reliable but I couldn't live with the occasional choppy redraw. It's really not the kind of CPU that you'd buy and expect to use without a high-end GPU anyway.

petra 3 hours ago | parent | prev | next [-]

I wonder what perf. this cpu can get in bit/ternary inference, and whether the 512AVX units(or whats it's called on AMD), get throttled.

I’ve heard that AMD chips generate a ton of heat with AVX512 operations, overclockers turn off the instruction set for more stability.

	▲	adrian_b 44 minutes ago \| parent [-]
		Any CPU generates more heat when it does more work, e.g. when more cores are active, or when using vector instructions. Using the AVX-512 operations is much more efficient, i.e. the same amount of work can be done by consuming less energy. For instance, if you have a program running an AVX computation on 4 cores, you could double the throughput either by using AVX-512 or by using 8 cores, but the former variant will produce less heat. For an overclocked system, where the normal power limits of the CPU are disabled, so it can consume a power great enough to exceed the capability of the cooler, it may make sense to disable AVX-512, for fear that one could run accidentally some program that is aware of AVX-512 and which would achieve a greater speed by using it, while also exceeding the power consumption that can be handled by the existing cooler. On the other hand, on a non-overclocked system or in an overclocked system with a very capable cooler, disabling AVX-512 is always a mistake, which can only increase the average power consumption.

izacus an hour ago | parent | prev [-]

Caches take die space. GPU takes die space.

People buying gaming CPUs tend to not really want iGPU taking away thermals, so it makes kinda sense?

	▲	nopurpose an hour ago \| parent [-]
		X3D cache doesn't take die space in traditional sense: it is a separate silicon packaged by stacking.