| > And writers are well known to be the true holders of power in the world... Martin Luther, Adam Smith, Karl Marx. All kinda famous for things they wrote, which changed the world because of those writings. > In any event, you can see that even among humans, the most persuasive aren't the most intelligent. Can you? Again, correlation. The village idiots don't generally get heard; the professors tend to be. > There are many addictive things, most of which have little to do with intelligence. Missing my point: these are not natural things found in the wild whose addictive nature is pure coincidence of biology, these things were made addictive by applied intelligence. > The economy on the other hand is very relevant. Even to the extent it can be controlled, which is a fairly large extent, there's unlikely to be a consensus on the desired outcome. An AI that has taken over doesn't need consensus, it only needs "the economy" to the extent that the economy provides specifically what it needs. > Anyway, people will have to choose to listen to a machine that claims it's very intelligent even though it will make plenty of mistakes (as intelligence often does). Is that how you know people to behave? Yes. Look at all the people who keep listening to Musk despite https://en.wikipedia.org/wiki/List_of_predictions_for_autono... Or same for Trump or Bush, both re-elected. Trump's second egregiously so, if you think people punish mistakes. And those two were both in a democracy; the British before universal suffrage had "Their's not to reason why, Their's not to make reply, Their's but to do and die"(https://en.wikisource.org/wiki/Maud,_and_other_poems/The_Cha...), while Chairman Mao had the disastrous Four Pests, Stalin the Holodomor, and Pol Pot… where do you even begin with him? > Some viruses. Probably some bacteria. Possibly some insects. I don't necessarily mean one single species, as they're all less intelligent than people. You said "biological species that are more capable of destroying humanity than the other way around". None of those are more capable of destroying humanity than the other way around. We have, in fact, entirely eliminated e.g. smallpox, but no disease, not smallpox, not HIV, not even the Black Death, was ever capable of wiping out the entire human species. We've got plans for gene-drives to wipe out (malarial) mosquitoes and the only reason we're holding back is uncertainty about the side effects on the broader ecosystem. If anything, our biggest problem in this regard is wiping out species and then regretting it later. |
| |
| ▲ | pron a day ago | parent | next [-] | | > Martin Luther, Adam Smith, Karl Marx. All kinda famous for things they wrote, which changed the world because of those writings. You're saying "some very influential people were intelligent writers". That does not contradict anything I said (you inverted the implication). > The village idiots don't generally get heard; the professors tend to be. Same logical mistake. > these things were made addictive by applied intelligence. There's no doubt intelligent things can do harm, but there is no direct correlation between intelligence and power. > An AI that has taken over doesn't need consensus Neither do humans that take over. Why is AI relevant here (especially as it will need the humans anyway)? > Yes. Look at all the people who keep listening to Musk Again, you're inverting the implication. Some people listen to intelligence; some to charisma or faith. I don't see what gives intelligence, artificial or otherwise, extraordinary power. > None of those are more capable of destroying humanity than the other way around. You're wrong. > We have, in fact, entirely eliminated e.g. smallpox, but no disease, not smallpox, not HIV, not even the Black Death, was ever capable of wiping out the entire human species. You keep inverting logical statements. You're saying: humans have destroyed some species, and some species have not destroyed humanity. These don't contradict what I said. | | |
| ▲ | ben_w a day ago | parent [-] | | > You're saying "some very influential people were intelligent writers". That does not contradict anything I said (you inverted the implication). I said that first, and of LLMs being already, today, more persuasive. You inverted the implication. Also, careful what stones you cast, you're in a glass house with a lot of the logical flaws of the stuff you've said already. At least one each of straw man, false dichotomy, non sequitur, false analogy / irrelevant comparison, whataboutism, false equivalence. Normally I wouldn't care so much, but if you want to make a game of it… > There's no doubt intelligent things can do harm, but there is no direct correlation between intelligence and power. False. Most leaders are above average intelligence. > Neither do humans that take over. Why is AI relevant here (especially as it will need the humans anyway)? Why did you bring it up then? Also, if you want to talk about logical fallacies: > (especially as it will need the humans anyway)?" When you're already saying in your first post "This entire analysis is predicated on the assumption that intelligence confers some unlimited power,"? > Again, you're inverting the implication. Some people listen to intelligence; some to charisma or faith. I don't see what gives intelligence, artificial or otherwise, extraordinary power. LLMs and other AI already demonstrated the power of persuasion to an above average level. I'd say "if you can't see it, that's on you", but precisely because of what it is, that's a little unfair: it's getting used to manipulate already, no reason you wouldn't be among those manipulated in this way. > You're wrong. Prove it. Name any combination of diseases or insects you like that has the potential to wipe out the human species. > You keep inverting logical statements. You're saying: humans have destroyed some species, and some species have not destroyed humanity. These don't contradict what I said. Your own actual words, again: "biological species that are more capable of destroying humanity than the other way around". Your claim is false, I have shown we have more power and your response is simple denial rather than arguing you claim. | | |
| ▲ | pron a day ago | parent [-] | | > I said that first, and of LLMs being already, today, more persuasive. You inverted the implication. I did not. Think again. > Also, careful what stones you cast, you're in a glass house with a lot of the logical flaws of the stuff you've said already. Possible, but I don't think so. Logic is my field (https://pron.github.io) > False. Most leaders are above average intelligence. Doesn't contradict what I said at all. > Why did you bring it up then? Because the question isn't "what can something in power do?" but whether intelligence necessarily lead to power. > When you're already saying in your first post "This entire analysis is predicated on the assumption that intelligence confers some unlimited power,"? I don't think you're even trying to understand what I write. > LLMs and other AI already demonstrated the power of persuasion to an above average level. Again, not relevant. > Name any combination of diseases or insects you like that has the potential to wipe out the human species. There could be microbes with the power to wipe out humanity (maybe not to the last human, but enough to destroy civilisation): https://pmc.ncbi.nlm.nih.gov/articles/PMC7122301/ Note that most papers are interested in likelihood, but my point is about potential. Microbes control more resources (and have more "computational capacity" at the biological level) than humans, and so they have more power even without intelligence. Anyway, the general point is that it's resources, not intelligence, that confer power. Intelligence can compensate, but up to a point. And there is no direct correlation between intelligence and control of resources. Even among humans, collaboration in the use of resources among people often results in much more power than that of a much smaller group of more intelligent people (and BTW, plants also have more power because of their huge biomass (not claiming that they're likely to wipe us out)). The more concrete point is that a machine that is more intelligent than any human will not necessarily have more power than every human. "ASI", "aligned" or otherwise, does not necessarily lead to control. We could, of course, choose to give it control, but that's not a matter of technology, and there's clearly no social or historical reason to believe that that choice is inevitable or even the most likely (we don't choose to put the most intelligent among us in control). My simple example was an "ASI" that tells us we must sacrifice something to control climate change, which happens to be what the most knowledgeable among us are already saying. Not to mention, of course, that different instances of such an AI are likely to disagree with each other quite a lot (because intelligence is insufficient to predict, control, or even fully observe nonlinear systems). Even partial success requires a political allocation of resources. Suppose that a clever AI says that it will be able to construct a more fair economy, but to do so it needs observations that require people to share more personal information and building that infrastructure requires raising taxes. The road from AI to machine overlords is not a simple one. |
|
| |
| ▲ | defrost a day ago | parent | prev [-] | | > The village idiots don't generally get heard; the professors tend to be. Populists persuading masses and leading them on don't tend to be professors. See "Professors" Mussolini, Hitler, Yaxley-Lennon, Trump, et al - not exactly the sharpest crayons in the sun. | | |
| ▲ | ben_w a day ago | parent [-] | | "Tend". Averages, not exceptions. | | |
| ▲ | defrost a day ago | parent [-] | | Sure, is it your position that a majority of popular movements are lead by professors then? As an aside, there's no personal snipe here or stance against yourself or broader arguments - just an extremely raised eyebrow toward this particular snippet. In general I find highly persuasive populists to have an exceptional EQ type intuition about what moves the needle with a crowd or an audience .. which is often not well correlated with notably high "raw problem solving intelligence" of the STEM or even classics literature variety. | | |
| ▲ | ben_w a day ago | parent [-] | | > Sure, is it your position that a majority of popular movements are lead by professors then? My position is that they're generally led by above-average people. "Professors" is a stand-in to contrast rhetorically with "village idiots". > As an aside, there's no personal snipe here or stance against yourself or broader arguments - just an extremely raised eyebrow toward this particular snippet. :) > In general I find highly persuasive populists to have an exceptional EQ type intuition about what moves the needle with a crowd or an audience .. which is often not well correlated with notably high "raw problem solving intelligence" of the STEM or even classics literature variety. Sure, there's a lot of problems with all measures of intelligence, which is why I (try to always say) "trends". I've just been watching an old episode of the UK TV satirical news show "Have I Got News For You": it is a long running series in which Paul Merton (self-described as having a highest qualification of "CSE ungraded in metalwork"), almost always defeats Ian Hislop (Oxford educated, editor of Private Eye, a satirical news magazine). Including that one time Paul Merton's teammate was literally a tub of lard, and one round of questions (with the tub of lard) were in languages he didn't speak. Paul Merton may have utterly failed at school, but he's clearly very intelligent. LLMs seem to have already reached the "quite persuasive" phase before they even got good at code and maths. Even a very early one convinced Blake Lemoine to make a fool of himself. And non-linguistic AI like the social media algorithms got addictive, likewise, without even being good at the things they're ostensibly for like recommending groups to join and old friends to connect with (though how much Facebook etc. are even really trying to do those things is unknown outside the company). |
|
|
|
|