Open Source here is not enough as hardware ownership matters. In an open source world, you and I cannot run the 10 trillion param model, but the data center controllers can.

▲

txrx0000 4 hours ago | parent | next [-]

I agree. We will need hardware ownership as well eventually. But the earlier you open-source, the more you slow down the centralization because people will be more likely to buy hardware to run stuff at home and that gives hardware companies an opening to do the right thing.

▲

layer8 4 hours ago | parent | prev [-]

Sure, but we could have Hetzners and OVHs who just provide the compute for whatever model we want to run.

▲

medi8r 3 hours ago | parent [-]

Checked the DDR5 price lately?

	▲	layer8 3 hours ago \| parent [-]
		I didn’t claim that it would be cheap. But I’d rather see the real cost of SOTA LLM use exposed. On the other hand, reportedly SOTA LLM inference is profitable nowadays, so it can’t be that expensive.