Why do you expect an AI developed in the same economic system would optimize for your preferences rather than their revenue? I think this only works if people can run, fine-tune and update their own models -- otherwise the giant AI vendors have every incentive to nudge you towards whichever retailer is bidding most on your Sponsored Responses, right? I think the only difference will be that instead of advertising to target a query, they'll eventually need to target a vector and its neighborhood, and there will be some greater opacity facing advertisers trying to match "middle-income US users shopping for airfryers who have product height limits posed by kitchen upper cabinets" or something.

Yeah I truly do not understand some people’s logic. Like the ones talking about some post scarcity world where universal income will offset AI related job loss. So the people in power, the ones who have constantly tried to cut back government spending, are now going to flip and support universal income? Right.

Competition and Open models will keep AI providers more honest - Google and Amazon are monopolies so they can enshittify and users have no recourse.