Remix.run Logo
dgellow 5 hours ago

Memory isn’t getting cheap soon, and you need a lot of it for local models

sisve 5 hours ago | parent [-]

All depends. The current technology will be cheaper in a year or two. The best cutting edge stuff will properly be even more expensive. But in 10 years time... we can run current SOTA models (or models that are equally good ) on our local hardware

dgellow 5 hours ago | parent [-]

Ah yes, if you count in decades, for sure I expect to run them locally