| ▲ | FuckButtons 2 hours ago | |
A 3 bit quant will run on a 128gb MacBook Pro, it works pretty well. | ||
| ▲ | nl 2 hours ago | parent [-] | |
A 3 bit quant is quite a lot weaker than the OpenRouter version the OP is using. | ||
| ▲ | FuckButtons 2 hours ago | |
A 3 bit quant will run on a 128gb MacBook Pro, it works pretty well. | ||
| ▲ | nl 2 hours ago | parent [-] | |
A 3 bit quant is quite a lot weaker than the OpenRouter version the OP is using. | ||