Remix.run Logo
cco 5 days ago

Wow! 3x is huge.

I've had great experiences with gpt-oss20b on my laptop, a genuinely useful local model.

3x probably doesn't get my Pixel Pro 9 to being able to run 20b models, but its getting close!

HenryNdubuaku 5 days ago | parent [-]

Although GPT OSS 20B has 1.7B activated parameters which will be fast, 20B weights is a lot for developers to bundle or consumers to download. That’s the actual problem.