| ▲ | logicallee 3 hours ago | |
Thanks for sharing that. What kind of hardware are you running this on? | ||
| ▲ | fortyseven 2 hours ago | parent [-] | |
4090, 128gb of ram (long before you'd have to take out a loan). I'm fairly sure it would run just as fine on a 3090. Thanks to the settings suggestions in the article, I was able to squeeze in the 31b model. Still testing, but it's real tight in 24gb of vram. A bit slower, too, but usable. Not sure I'm seeing much of a quality boost yet, but I'm still testing. | ||