Remix.run Logo
lcnPylGDnU4H9OF 42 minutes ago

Yeah, a good rule of thumb is that the weights take up ~100% of the size of the model, so 100B bytes (8-bit quant) would be, well, 100GB and a 4-bit quant would be half that.

tommica 6 minutes ago | parent [-]

Oh, that is a useful rule to know! Thanks!