| ▲ | rpdillon 6 hours ago | |
If I recall correctly, Strix Halo gets about 450G/s. The M series processors get between 400 and 800G/s, and an actual NVIDIA card is like 5.5T/s. 113G/s is pretty slow for inference. | ||
| ▲ | dust42 6 hours ago | parent | next [-] | |
The CPU is for mobile phones. An Nvidia H200 has 4.8TB/s. An RTX 5090 has 1.8TB/s. Both use ~700W - not comparable with a phone. | ||
| ▲ | trvz 6 hours ago | parent | prev [-] | |
Strix Halo is 256 GB/s. | ||