| ▲ | paxys 5 hours ago | |||||||||||||||||||||||||||||||||||||||||||||||||
Or more simply – $25K (+ tax) put in a savings account will earn about enough interest to pay for a $100/month AI subscription indefinitely. And at the end of it you still have the $25K. | ||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | AbsurdCensor 5 hours ago | parent | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||
Not 'more simply', there are basically zero savings accounts that are going to net you a 5%+ interest rate to give you that $100 a month. And that $25k becomes less valuable over time. $25k is now only worth $19k because inflation. | ||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | kphorn 5 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||
It’s basically impossible to compete on economic terms with deeply subsidized hardware that is widely available to rent or as a service with zero commitment. For general inference there’s no ROI that makes this work vs subscriptions. 25k for computer now, plus 9-10% sales tax, plus operating cost, plus time and cost for R&D tinkering with models, harnesses, and infra (assuming highly capable engineering talent that can get paid for your human inference) vs a HEAVILY subsidized subscription at 200 per month with free R&D has a pretty long ROI (15 years?) At API costs, it’s like 6 months if you’re heavy on inference. For training, specialized models will have their own ROI that makes this worthwhile. Then debate renting capacity and the platform to choose | ||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | sanderjd 5 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||
Isn't there something to be said for owning your own hardware though? | ||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | bilbo0s 5 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||
This is the real answer. Unless you need privacy for your inference this instant, paying for credits can get 80 to 90 percent of people everything they need. Of course if you do need that privacy, then forking the $25K over to Apple is a no brainer. | ||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | physicalecon 4 hours ago | parent | prev [-] | |||||||||||||||||||||||||||||||||||||||||||||||||
[dead] | ||||||||||||||||||||||||||||||||||||||||||||||||||