▲ | beefnugs 20 hours ago | |
Its not even close dude, the nvidia stuff is like 2000 TOPS vs the 50 you get from the ai 395+ | ||
▲ | adrian_b 18 hours ago | parent | next [-] | |
True, but this advantage is strictly for AI inference and only when using the very low resolution FP4 and sparse matrices. When using bigger number formats and/or dense matrices the advantage of Thor diminishes considerably. Also the 50 Tops is only from the low power NPU. When distributing the computation also over GPU and CPU you get much more. So for a balanced comparison one has to divide the Thor value by 4 or more and multiply the Ryzen value by a factor that might be around 3 or even more. The Ryzen CPU is significantly better, and the GPU has about the same size but a much higher clock frequency, so it should also be faster, so for anything except AI inference a Ryzen Max at half price will offer much more bang for the buck. | ||
▲ | 19 hours ago | parent | prev [-] | |
[deleted] |