Because all the boomers and a lot of genX grew up with them being something that was ludicrously expensive due to rapid transit costs that now no longer exist now that we know how (other than sheer speed) to keep them from spoiling between tree and grocery store and around the same time that we got good at that we lifted a ban on mexican imports.

It used to be oranges that were the luxury fruit.