Remix.run Logo
adrian_b 17 hours ago

True, but this advantage is strictly for AI inference and only when using the very low resolution FP4 and sparse matrices.

When using bigger number formats and/or dense matrices the advantage of Thor diminishes considerably.

Also the 50 Tops is only from the low power NPU. When distributing the computation also over GPU and CPU you get much more. So for a balanced comparison one has to divide the Thor value by 4 or more and multiply the Ryzen value by a factor that might be around 3 or even more.

The Ryzen CPU is significantly better, and the GPU has about the same size but a much higher clock frequency, so it should also be faster, so for anything except AI inference a Ryzen Max at half price will offer much more bang for the buck.