| ▲ | KaiserPro 5 hours ago | |
Excellent, with stunning insight like this, you can see why this VC is earning the big bucks. This is almost economics level of line projection. It would be good to understand _why_ anthropics "AI" bill is so high. First, They are going to be renting a lot of inference compute just to service customers (Meta's Capex bill is about 2x its wage bill) It then also needs a huge amount of infra to both run training and experimentation. THats probably a third of the cost. (storage and physical infra to get the most out of storage and compute is hard. Then getting it reliable, so that shit state doesn't propogate across the shared memory plane is very hard. The other thing to note is that claude usage inside anthropic is tiny compared to the customer's usage. even with uber agents at "mythos++" its going to be at best a few thousand servers. not like the massive fleet needed to serve the paying customer. So using anthropic as some sort of rational target to base any kind of prediction is madness. Its like looking at lyons tea rooms and going yeah, every company is going to spin up an R&D arm to make a company specific computer: https://www.sciencemuseum.org.uk/objects-and-stories/meet-le... ALSO this assumes that the current way of running LLMs is the way forward. Custom software is expensive (in both time and tokens) to look after, its much easier and cheaper to buy it in from SaaS companies and let them figure that shit out. (yes I know SaaS apocalypse, but you are paying for real world experience, and a packaged way of doing things, rather than experimenting your self, where in a lot of cases the company doing the experimentation doesn't know what its doing) | ||