There's a far greater hazard than AI boosting itself:

As models are under direct control of totalitarian silos, ideology can be baked into every tendril of knowledge represented.

A service such as Gemini may be a societal ideological risk on a greater scale than the notoriously fascist influence of radio/TV in the 1920s and 30s.

"Guardrails" are direct lines of injection of ideology, and "hallucinations" can serve to mask.

Why should anyone trust singular corporate control points for doctrine on the totality of knowledge? It seems like a crazy risk.

News is already utterly polluted with doctrinaire bias.

Politics are clearly designed to keep the electorate away from decision-making, and open doors to privileged silos of control.

AI can own the populace coming and going as the models inject doctrine into the core of knowledge and scour the consumer for measures doctrinal uptake and alignment. Will information become totalized with no possibility of escape?