| ▲ | m0rde 10 hours ago | |||||||
> The noticeable spike [~20 percentage points] in May in the figure above [tool invocations] was largely attributable to one sizable account whose activity briefly lifted overall volumes. The fact that one account can have such a noticeable effect on token usage is kind of insane. And also raises the question of how much token usage is coming from just one or five or ten sizeable accounts. | ||||||||
| ▲ | nhaehnle 5 hours ago | parent [-] | |||||||
It is quite interesting to ponder these usage statistics, isn't it? According to their charts they're at a throughput of something like 7T tok/week total now. At 1$/Mtok, that's 7M$ per week. Less than half a billion per year. How much is that compared to the total inference market? And yet again, their throughput went like 20x in one year, who knows what's to come... | ||||||||
| ||||||||