Remix.run Logo
redoxate 5 hours ago

Oh no, some run on iPhones

api 4 hours ago | parent [-]

They're pretty basic and hallucinate a lot. There are some hard limits to how good you can get on a model that fits on a phone.

Qwen3 and Gemma level models that run on mid-high end laptops and desktops can be pretty good. Not frontier grade, but shockingly competent for something that runs on a single PC. But the hardware you need to run those fast is at least $1000-$2000. Cheap hardware can run them, but slooooooow.

ourcat 3 hours ago | parent | next [-]

And then you've got the local "Wan2GP" setups "for the GPU-Poor".

Also tried the "Locally Uncensored" setup on a 3060 laptop, which worked surprisingly well.

imhoguy 4 hours ago | parent | prev [-]

You can still lease GPU farm in many "easy" countries.