| ▲ | yassa9 9 days ago | |
what quantization did u try ? u can use Q4 quantization, im pretty sure that 48GB would be enough | ||
| ▲ | sgt101 7 days ago | parent [-] | |
8bits is fine.... I was talking full bore. | ||
| ▲ | yassa9 9 days ago | |
what quantization did u try ? u can use Q4 quantization, im pretty sure that 48GB would be enough | ||
| ▲ | sgt101 7 days ago | parent [-] | |
8bits is fine.... I was talking full bore. | ||