you underestimate the amount of people that use google relative to software engineers "running agents continuously for tens of hours"

Maybe? But it's so many orders of magnitude apart. I can easily do 1B tokens a day (output tokens is probably like 3M?).

When I see non technical people use that Google reply I'd be surprised if it's more than 1k output tokens, and with a tiny model. So a 3000x in output tokens, on a model at least 10x as expensive, I wouldn't be surprised if hardware usage is 30.000x for a dev that uses coding subs vs someone who uses the Google AI overview a couple of times a day.

And that's not counting the absurd difference in cache reads.