Remix clone Hacker News
new
|
show
|
ask
|
jobs
Github
▲
MrScruff
an hour ago
I get around 20 tok/s, 4 bit quant, MTP, 4 bit KV cache quantisation. On an M4 Pro 48Gb.