| ▲ | goatley 6 hours ago | ||||||||||||||||
Finally, a model small enough to self-host on my 2012 MacBook Air if I don't mind my house reaching room temperature in 2 seconds. | |||||||||||||||||
| ▲ | alex_duf 6 hours ago | parent [-] | ||||||||||||||||
You might be missing three 0s on the parameter count, or what am I missing? I'm assuming you need somewhere 0.5 to 1TB of RAM for the weights only | |||||||||||||||||
| |||||||||||||||||