If investors knew how powerful open models are the AI companies valuation would tank overnight

sunaurus 3 hours ago | parent | next [-]

Well, with the recent news about OpenAI being unable to find investors, I feel like it's already happening

	▲	m00dy 3 hours ago \| parent [-]
		Don’t trust the news, especially now that AI is seen as part of US national security. We’re in a war, both financially and technologically.

▲

yolo3000 3 hours ago | parent | prev | next [-]

You still need to run them on GPUs

▲

Tade0 2 hours ago | parent | next [-]

MoE models can be largely offloaded to system RAM - recent versions of llama.cpp automatically distribute parts of the model, with all the dense parts going into VRAM and just the routed experts residing in system RAM.

I'm currently running Qwen3 Coder Next, which is a 80B A3B model, at 15tps on a 8GB 7700S and 64GB RAM.

It's an idiot (no Thinking), so it has to go over its work several times to get it right, but it's the largest idiot I can feasibly run at the moment.

Also by accident I'm undercutting the only provider of this model on OpenRouter by 40%, doing $0.48/mTok.

Of course at my token rate it would take an entire day to even reach a million tokens, but it's the principle that matters.

▲

jabron 3 hours ago | parent | prev | next [-]

AI companies aren't valued on the GPUs they own.

	▲	m00dy 3 hours ago \| parent [-]
		I think he meant NVIDIA is the winner in the end.

▲

wg0 3 hours ago | parent | prev [-]

And GPUs anyone can buy.

	▲	abc123abc123 2 hours ago \| parent [-]
		And if the market teaches us one thing, it is that GPU prices will drop over time. The current absurd prices is attracting competitors, and the more competitors, the lower the price. I would not be surprised if, in 5 years, there's a neat, low-power GPU in high end laptops, alternatively, a cheap, say 500 USD or so, GPU in a box, that you can use for your AI-center at home or in the office.

▲

rrr_oh_man 3 hours ago | parent | prev | next [-]

No, it would be hyped up even more for a pump & dump :)

▲

epolanski 2 hours ago | parent | prev [-]

Many companies are figuring this out.