| ▲ | jen729w a day ago | |||||||
Honestly though how many people reading this do you think have that setup vs. 85% of us being on a MBx? > The Qwen3-Coder-480B-A35B model could also be run on a 4090 or 5090 by splitting the active 35B parameters across VRAM and RAM. Reminds me of running Doom when I had to hack config.sys to forage 640KB of memory. Less than 0.1% of the people reading this are doing that. Me, I gave $20 to some cloud service and I can do whatever the hell I want from this M1 MBA in a hotel room in Japan. | ||||||||
| ▲ | radicalbyte a day ago | parent | next [-] | |||||||
> Reminds me of running Doom when I had to hack config.sys to forage 640KB of memory. The good old days of having to do crazy nutty things to get Elite II: Frontier, Magic Carpet, Worms, Xcom: UFO Enemy Unknown, Syndicate et cetera to actually run on my PC :-) | ||||||||
| ||||||||
| ▲ | reaslonik a day ago | parent | prev [-] | |||||||
>I can do whatever the hell I want from this M1 MBA in a hotel room in Japan. As long as it's within terms and conditions of whatever agreement you made for that $20. I can run queries on my own inference setup from remote locations too | ||||||||
| ||||||||