| ▲ | dualvariable 2 hours ago | |
> Connecting the optimizing machine to real world actions without human oversight is not a neutral or blameless choice. Yep. The fact that they lack hard constraints (unlike an SQP optimizer) and all this talk of "alignment" is also just a feature (or misfeature) of the algorithm. The way that people/researchers choose to use those algorithms, even in the presence of those limitations, doesn't mean the algorithm is "rogue"; it means the humans didn't build in enough external hard constraints. It is like passive voice, blaming the algorithm instead of the researchers running it. | ||