▲ | api 13 hours ago | ||||||||||||||||
You don’t just beat around the bush here. You actually beat the bush a few times. Large corporations, governments, institutionalized churches, political parties, and other “corporate” institutions are very much like a hypothetical AGI in many ways: they are immortal, sleepless, distributed, omnipresent, and possess beyond human levels of combined intelligence, wealth, and power. They are mechanical Turk AGIs more or less. Look at how humans cycle in, out, and through them, often without changing them much, because they have an existence and a weird kind of will independent of their members. A whole lot, perhaps all, of what we need to do to prepare for a hypothetical AGI that may or may not be aligned consists of things we should be doing to restrain and ensure alignment of the mechanical Turk variety. If we can’t do that we have no chance against something faster and smarter. What we have done over the past 50 years is the opposite: not just unchain them but drop any notion that they should be aligned. Are we sure the AI alignment discourse isn’t just “occulted” progressive political discourse? Back when they burned witches philosophers would encrypt possibly heretical ideas in the form of impenetrable nonsense, which is where what we call occultism comes from. You don’t get burned for suggesting steps to align corporate power, but a huge effort has been made to marginalize such discourse. Consider a potential future AGI. Imagine it has a cult of followers around it, which it probably would, and champions that act like present day politicians or CEOs for it, which it probably would. If it did not get humans to do these things for it, it would have analogous functions or parts of itself. Now consider a corporation or other corporate entity that has all those things but replace the AGI digital brain with a committee or shareholders. What, really, is the difference? Both can be dangerously unaligned. Other than perhaps in magnitude? The real digital AGI might be smarter and faster but that’s the only difference I see. | |||||||||||||||||
▲ | brookst 12 hours ago | parent [-] | ||||||||||||||||
I looked but I couldn’t find any evidence that “occultism” comes from encryption of heretical ideas. It seems to have been popularized in renaissance France to describe the study of hidden forces. I think you may be hallucinating here. | |||||||||||||||||
|