The difference is ISPs usually have monopoly/duopoly pricing power and LLMs already have freely available open source models. If one AI company decides they want to start gouging, they have to compete with other providers AND open source. And if all of the ai companies start colluding on price gouging, there’s always the option of new competitors cloud hosting open source models.

That said I do think eventually prices will increase somewhat, unless SOTA models start becoming profitable at current prices (my knowledge is at least 6 months old on this so maybe they have already become profitable?)