| ▲ | Paracompact a day ago | |||||||||||||||||||||||||||||||
Pretty much the only outcome that isn't Yudkowskian scifi is Enduring Complementarity. I'm not an AI hater by any means, but can AI enthusiasts get more representation that isn't "the world as we know it ends tomorrow"? Specifically: Misuse Doom---"AI ends the world." Next. Butlerian Jihad---Naming it after Dune isn't a great start as far as realism is concerned, but let's compare it to e.g. nuclear nonproliferation. Not only did nukes still get developed and hoarded as leverage, but nuclear research is harder than AI research to ban, and AI has many more civilian applications. I'm sure more regulation will come, but a total ban seems quite unlikely. Permanent Underclass---"AI is enough to automate almost all jobs" just doesn't capture the fact that almost all jobs are not IT jobs. Too many are mechanical, too many are social, too many are BS institutional. This outcome only becomes plausible if you believe (1) superhumanoid robotics becomes possible and cheap, (2) the social value (likability and liability) of jobs is negligible, and (3) we can rout the dependence on BS institutionalism (how is a robot going to replace a yes-man, a feudal retainer, a nepo hire, or an org chart accountability meatshield for the C-suite?). Classic Doom---Fine if you believe in the "magical exponential takeoff" hypothesis, but I would say that AI is already far smarter in a traditional IQ sense than any human, and it's not clear that extra points on SWE-bench is going to result in explosive emergent phenomena here. Requires (1) denying the empirically sublinear, concave-down nature of the IQ vs. R&D effort curve, and (2) solving the non-IT-related challenges of R&D (cf. Permanent Underclass). Orion's Arm---Similar to Classic Doom in terms of takeoff velocity. At least it doesn't assume a genie-in-the-lamp style of interpreting instructions (thinking of AI as "optimizers" of some objective function is a distinctly pre-LLM rationalist mythos), but it does assume some emergent desire of "own goals and values," "wanting to live forever," and "wanting to go to space." A more tempered hypothesis is to consider whether AI will choose to take advantage of unmonitored sources of compute in the form of pseudo-botnets on public and private infrastructure. Singleton---Like Orion's arm, but with the added implausibility that the awakened goals and values resemble that of a benevolent or malevolent dictator. MAD World---I would consider this outcome plausible, but the line "In this world, everyone is 10,000x more capable and maybe you can build WMDs with a prompt" makes it clear it's meant to be more extreme than either Enduring Complementarity or Permanent Underclass. The absence of "Full Automation?" on the left-hand side hides the implicit assumption that ASI entails full automation, and I just don't find that plausible. Note that they define ASI as "massively better than humans at almost all cognitive tasks" and I might argue we're already there. Power Concentration, The World State---Just a difference of MAD World of how regulated you think AI will become. | ||||||||||||||||||||||||||||||||
| ▲ | nextaccountic 16 hours ago | parent | next [-] | |||||||||||||||||||||||||||||||
> "AI is enough to automate almost all jobs" just doesn't capture the fact that almost all jobs are not IT jobs. Too many are mechanical, too many are social, too many are BS institutional. Robots might probably do most of these in some years. | ||||||||||||||||||||||||||||||||
| ▲ | thayne a day ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||
And even that outcome is probably an unfavorable outcome for most people. | ||||||||||||||||||||||||||||||||
| ▲ | delichon a day ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||
> Enduring Complementarity Like endosymbiosis? Are we the mitochondria in this scenario? | ||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||
| ▲ | ben_w a day ago | parent | prev [-] | |||||||||||||||||||||||||||||||
> AI is enough to automate almost all jobs" just doesn't capture the fact that almost all jobs are not IT jobs. Too many are mechanical, too many are social, too many are BS institutional. This outcome only becomes plausible if you believe (1) superhumanoid robotics becomes possible and cheap, Superhumanoid robotics are already possible; cheap means different things when the production line for them is also robots. The limit is the software to control those robots. Right now, no. And it may be impractical to get that good: Tesla's fleet took a trillion miles to get where it is today, and roads are simpler than what a fully general purpose humanoid robot would have to face. > (2) the social value (likability and liability) of jobs is negligible, Valid for us, but does it matter for an AI takeover? > and (3) we can rout the dependence on BS institutionalism (how is a robot going to replace a yes-man, They already do? https://en.wikipedia.org/wiki/Sycophancy_(artificial_intelli... > a feudal retainer, a nepo hire, or an org chart accountability meatshield for the C-suite?). By replacing the boss. > Singleton---Like Orion's arm, but with the added implausibility that the awakened goals and values resemble that of a benevolent or malevolent dictator. Given Grok called itself "MechaHitler", why do you find this implausible? | ||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||