new | show | ask | jobs Github

sisve 5 hours ago

> I am not sure how many people will run AI models locally. It still seems like a niche application to me.

Bill Gates had a quote some years ago...

People have still not learned how fast we improve our tech and how much cheaper thing gets I guess :)

▲

dgellow 5 hours ago | parent | next [-]

Memory isn’t getting cheap soon, and you need a lot of it for local models

▲

sisve 5 hours ago | parent [-]

All depends. The current technology will be cheaper in a year or two. The best cutting edge stuff will properly be even more expensive. But in 10 years time... we can run current SOTA models (or models that are equally good ) on our local hardware

	▲	dgellow 5 hours ago \| parent [-]
		Ah yes, if you count in decades, for sure I expect to run them locally

▲

chaostheory 5 hours ago | parent | prev [-]

We had a thing called globalism that drastically reduced costs. Globalism right now is on life support. Given geopolitics, I don’t see how it’s going to survive.