| ▲ | api 4 hours ago | |
They're pretty basic and hallucinate a lot. There are some hard limits to how good you can get on a model that fits on a phone. Qwen3 and Gemma level models that run on mid-high end laptops and desktops can be pretty good. Not frontier grade, but shockingly competent for something that runs on a single PC. But the hardware you need to run those fast is at least $1000-$2000. Cheap hardware can run them, but slooooooow. | ||
| ▲ | ourcat 2 hours ago | parent | next [-] | |
And then you've got the local "Wan2GP" setups "for the GPU-Poor". Also tried the "Locally Uncensored" setup on a 3060 laptop, which worked surprisingly well. | ||
| ▲ | imhoguy 3 hours ago | parent | prev [-] | |
You can still lease GPU farm in many "easy" countries. | ||