| ▲ | thewebguyd 3 hours ago | |||||||
No disagreement on computing 2.0, but companies spending 3-5k per employee for hardware isn't generally a monthly cost. It's a at the time of hire, and then once every 3 to 5 years after that, for a monthly amortized cost of about $50/employee. I have my concerns with current inference pricing in that there's a non-zero possibility for a rug pull in the future for the subscription plans for organizations and individuals that can still use them. For now, its only companies larger than ~150 users that need to pay per token, but what if that wasn't the case? Not every company can afford over $1k/month/employee to give them access to AI tooling, further making it harder to compete against the behemoths. If we get to a point where an individual can no longer pay $100/month for nearly unlimited usage and instead must pay per token, that's going to be a problem. Personal computing eventually became an equalizer (until we started centralizing on mainframes again, aka the cloud) because it got cheap. My hope is that inference also gets just as, if not cheaper. I have high hopes for local AI and open weight models and we will continue the ethos of local, personal computing and not needing to offload everything to OpenAI/Anthropic/Google, etc. to get work done once the hardware and hardware availability catch up. | ||||||||
| ▲ | GrinningFool an hour ago | parent | next [-] | |||||||
Any kind of rug-pull is a serious concern. Companies are re-orienting their entire development processes around these tools. Sure they can go back, but it will require a much larger and more expensive effort than to transition in the first place. All companies who make this transition will be more or less at the mercy of model providers. | ||||||||
| ▲ | dghlsakjg 3 hours ago | parent | prev [-] | |||||||
Every employee doesn't need $1k in token spend per month, either. That kind of spend makes sense for technical workers in r+d. Most other workers are served fine by $20-30 worth of tokens on a budget model. You don't need Opus to help support write emails. | ||||||||
| ||||||||