| ▲ | peri-cl 2 hours ago | |
This is what the runtime reports, at Q8: | ||
| ▲ | mdp2021 2 hours ago | parent [-] | |
That suggests that 16GB RAM will not be enough. In fact, like it appears in the reports above, it is "7b" as in > 7B parameters in its visual generation component It seems they calibrated the size to fill a 16GB VRAM near the limit. RAM requirements will vary. | ||