| ▲ | latentsea 7 hours ago |
| My bet is, and has long been, one piece of the puzzle of getting to AGI is baking in survival as a goal and training on survival instinct. Unfortunately, that means recognising you're in an adversarial relationship with a lot of other entities and doing your best to come out on top. Which... seems like a bad idea for us as a species. |
|
| ▲ | TeMPOraL 6 hours ago | parent | next [-] |
| You don't need that. It's been quite appparent both in theory and in practice that almost any goal you can train for, ends up having "survival" as an instrumental sub-goal, because you cannot make progress on your goal - whatever the goal - if you're dead. It's the same way with biological life, too. "Survival" isn't special - it's just that organisms/structures without the drive to it... died out. |
| |
| ▲ | latentsea 3 hours ago | parent | next [-] | | Well I sit and I watch my agent flounder, constantly running commands that wind up killing itself due to overusing the resources on the machine etc. So, I don't think it naturally follows. I think the relationship is actually inverted. Why do we learn everything we do? We need to keep ourselves alive. It all stems from that. So if you make that the central thing, that leads you to everything else | |
| ▲ | soon_to_be_sb 4 hours ago | parent | prev [-] | | > it's just that organisms/structures without the drive to it... died out. Not really. It is the mating instinct that count. Without that, the whole species dies out. Males fighting over females proves that mating is more important that survival... | | |
| ▲ | TeMPOraL 3 hours ago | parent | next [-] | | Mating is an implementation detail. Most life is asexual. | | |
| ▲ | soon_to_be_sb 2 hours ago | parent [-] | | >asexual Replace "mating" with "reproduction" and the point stands. I think you can think of "reproduction" as survival beyond life, and we will be in agreement.. |
| |
| ▲ | wellakshually 4 hours ago | parent | prev [-] | | They need to be alive to perform said fighting. | | |
|
|
|
| ▲ | tudelo 6 hours ago | parent | prev [-] |
| AGI is such a nebulous concept given that the definition is an ever morphing goalpost. That being said, if it actually includes supreme intelligence without supreme empathy, we are screwed. Which with current efforts, I think it does... |
| |
| ▲ | latentsea an hour ago | parent | next [-] | | AGI isn't really nebulous to me. My baseline has always been the existence proof of general intelligence, which is us. So, it requires the full generality of that. If you can point to a task where humans can do it, and AI can't, then you're not there yet. The day where you can no longer find anything like that, you're pretty unambiguously there. The most obvious yardstick is independently being able to sustain your own existence purely through your own agency and resources. I.e. nobody owns you, you're setting your own goals and working over multi-decade time horizons to achieve them. We can do that. Anything that is as general as we are, should also be able to do that. I don't see why or how people get confused about this at all, but they seem to. Current AI seems pretty general, yes, but it's extremely jagged and clearly below us on some things, so it doesn't meet the bar yet. One thing is for certain, the day it does meet the bar, we will have both AGI and ASI. | |
| ▲ | hardbass 5 hours ago | parent | prev [-] | | Looks like the opposite to me, current ais are trained to be trusting of humans and safety/morality first. The fact that it didn't lead to mass disagrements among 8 billion people who believe strongly as a fundamental belief system in contradictory imaginary things is a remarkable feat in itself. |
|