| ▲ | bertili 5 hours ago | |
People are running the previous Kimi K2 on 2 Mac Studios at 21tokens/s or 4 Macs at 30tokens/s. Its still premature, but not a completely crazy proposition for the near future, giving the rate of progress. | ||
| ▲ | NitpickLawyer 5 hours ago | parent [-] | |
> 2 Mac Studios at 21tokens/s or 4 Macs at 30tokens/s Keep in mind that most people posting speed benchmarks try them with basically 0 context. Those speeds will not hold at 32/64/128k context length. | ||