| ▲ | redox99 6 hours ago | |
Maybe? But it's so many orders of magnitude apart. I can easily do 1B tokens a day (output tokens is probably like 3M?). When I see non technical people use that Google reply I'd be surprised if it's more than 1k output tokens, and with a tiny model. So a 3000x in output tokens, on a model at least 10x as expensive, I wouldn't be surprised if hardware usage is 30.000x for a dev that uses coding subs vs someone who uses the Google AI overview a couple of times a day. And that's not counting the absurd difference in cache reads. | ||