| ▲ | svara an hour ago | |
I don't think we'd be okay with that if it took a few years longer, right? I thought the Bengio blog post posted here the other day answered that question quite well (ignoring your timeline). The argument is that in training for the capability to achieve certain goals, you may inadvertently also train for secondary instrumental goals you did not intend, such as aggressive behavior or deception. I'm actually no sure I buy that this is particularly likely, or necessary, but I found that take reasonable and worth considering. | ||