▲ | cco 5 days ago | |
Wow! 3x is huge. I've had great experiences with gpt-oss20b on my laptop, a genuinely useful local model. 3x probably doesn't get my Pixel Pro 9 to being able to run 20b models, but its getting close! | ||
▲ | HenryNdubuaku 5 days ago | parent [-] | |
Although GPT OSS 20B has 1.7B activated parameters which will be fast, 20B weights is a lot for developers to bundle or consumers to download. That’s the actual problem. |