Because it doesn't even come close to frontier models in intelligence/speed/price. I can run my 3090 nonstop and rack up an electricity bill that costs more than a subscription and get worse results that are slower. They are ok for simple/non complex things, but that's not really what I need AI for.

▲

datsci_est_2015 4 days ago | parent | next [-]

I feel the opposite. I do need AI for simple things. Complex things are usually so ill-defined that the actual bottleneck takes place in meatspace, not in my IDE.

▲

Hendrikto 4 days ago | parent | prev | next [-]

Well, it is currently cheaper because it is massively subsidized. That will change when subsidies stop. I don’t think it is a good argument.

▲

ihattendorf 4 days ago | parent | next [-]

The claim was "It is cheaper", not "It will be cheaper". Until it actually _is_ cheaper, it doesn't make much sense to purchase $10k+ in hardware to run local models that are still worse than the frontier offerings.

	▲	Chris2048 4 days ago \| parent [-]
		> Until it actually _is_ cheaper, it doesn't make much sense to purchase Once it is cheaper, there will be more demand so it will no longer be cheaper. Buying now gets current prices (though demand is still fairly high).

▲

hobofan 4 days ago | parent | prev | next [-]

No it's not. AI products are quite often subsidized. AI inference very certainly is not.

There are more and more independent AI inference providers without VC backing that serve open weight models on a ~cost-plus basis that show that subsidies are not significant for AI inference.

	▲	3 days ago \| parent [-]
		[deleted]

▲

voxleone 4 days ago | parent | prev [-]

[dead]

▲

cultofmetatron 4 days ago | parent | prev [-]

if only there was a place that was naturally cold to take advantage of airflow for cooling and cheap renewable electricity thats always on...

▲

plopz 4 days ago | parent [-]

are you saying aluminum smelters are going to convert to ai datacenters?

	▲	cultofmetatron 29 minutes ago \| parent [-]
		Imagine if they did and then redirected the heat from those data centers to warm their greenhouses and then to warm homes. honestly really surprised they haven't gone full ham on AI data centers.