| ▲ | Tepix 2 hours ago | |
The pp speeds are really slow (50), I think there‘s room for improvement still. | ||
| ▲ | kamranjon 2 hours ago | parent [-] | |
Ah yea after watching one of the creators youtube videos I realize these benchmarks are combining prefill and decode which isn't super helpful - it seems this struggles with the exact same bottlenecks as all strix halo setups, memory bandwidth. It seems this is still significantly slower than equivalent memory sizing on Mac hardware. | ||