Remix.run Logo
▲ dist-epoch 4 hours ago

Apple M6 has 80-100 TOPS.

Qualcomm Cloud AI 100 Ultra has 800 TOPS, almost 10 times more.

▲grosswait 3 hours ago | parent | next [-]

This could be very fast at running embedding models (if it supports the right modes)

▲ipsum2 3 hours ago | parent | prev [-]

Considering that memory bandwidth is the most important for inference for most neural networks, that matters more.

▲ 2 hours ago | parent [-]
[deleted]