I don't think the elite think all voters are dumb more like they think they're easy to manipulate to vote for something (which is largely true). Anecdotally I easily get manipulated by the type of information I consume. I occassionally catch it after the fact or a conversation with others but there's no telling how much I've just accepted that's manipulated.

From that angle it's a game of who has the money, power, and diatribution to enact this manipulation.

Twitter being a prime example. Is Elon "right"? Maybe but the main point is it doesn't matter as he has the distribution.

If you have money but low to no distribution -> you do what gary is doing. Maybe he'd be interested in removing rights to vote but someone like Zuck would NOT because he has outsized ability to influence as he sees fit.