Remix.run Logo
▲ WarmWash 7 hours ago

It's also going to be the downfall of open models.

If you think governments (US and China) are going to tolerate people using models for anti-social behavior, I have a datacenter to sell you.

▲logicchains 7 hours ago | parent [-]

This will be the downfall of the torrent protocol. If you think governments (US and China) are going to tolerate people downloading copyrighted games, movies and music without paying the rightsholder, I have a datacenter to sell you.

▲WarmWash 6 hours ago | parent [-]

Pirated content can run on a $20 computer.

SOTA open models need tens of thousands of dollars worth of hardware to run.

I get your analogy, and it feels right, but the compute requirements to run these models are extreme. That analogy falls apart when it necessitates having a corporate 3rd party run the models for you. They will not tolerate breaking laws.

If China says no more, then the best the masses are gonna get on their high-end setups are the 30B class models. Which are decent, but not "hack my bank", errr, "protect our bank" decent.

Piracy flourished because you only need an operating laptop to participate. LLMs you need a server rack of GPUs to participate.

▲wat10000 3 hours ago | parent [-]

30B models aren't that good for now. They keep getting better. Qwen 3.8 27B is as good as the best available model from a year or two ago. Will 2028's 30B models be as good as the best available today? No idea, but I wouldn't dismiss the possibility.

I'd also wonder about what you can get done with a smart model running very slowly. You can run the biggest open weights models on relatively mundane hardware if you don't mind measuring your speed in seconds per token. That's going to be untenable for interactive use, but might be fine for "go hack this thing for me" if you're patient.