Remix.run Logo
Tepix 2 hours ago

The pp speeds are really slow (50), I think there‘s room for improvement still.

kamranjon 2 hours ago | parent [-]

Ah yea after watching one of the creators youtube videos I realize these benchmarks are combining prefill and decode which isn't super helpful - it seems this struggles with the exact same bottlenecks as all strix halo setups, memory bandwidth. It seems this is still significantly slower than equivalent memory sizing on Mac hardware.