Please correct me if I'm incorrect, but it seems to me those numbers are describing a fairly different situation to this one. Anthropic serving their own model to their own users at that scale gets cache hit rates and machine utilisation that someone standing up another company's 2.8T model in four regions isn't going to get, and this thing needs 64 accelerators minimum before it will run at all, so a rack sitting mostly idle through a quiet hour costs the same as a busy one. The margin figure quoted is also just the price against the cost of producing the tokens, it doesn't have buying the hardware in it, or depreciation, or maintenance, or the money they'd have made renting those machines out instead, which with rental prices up 40% since October isn't nothing.

I largely agree things are overpriced, I just don't think that article is the right basis for saying it about this one.