| ▲ | dist-epoch 4 hours ago | |||||||
Apple M6 has 80-100 TOPS. Qualcomm Cloud AI 100 Ultra has 800 TOPS, almost 10 times more. | ||||||||
| ▲ | grosswait 3 hours ago | parent | next [-] | |||||||
This could be very fast at running embedding models (if it supports the right modes) | ||||||||
| ▲ | ipsum2 3 hours ago | parent | prev [-] | |||||||
Considering that memory bandwidth is the most important for inference for most neural networks, that matters more. | ||||||||
| ||||||||