Remix.run Logo
mikkelam 3 days ago

This is once again RLHF loops.

the AI labs are and have been 100% focused on correctness because it is easy to setup and validate.

Adding one more function that almost does the same thing as another will not break anything.

I think this is just a matter of time. At some point there'll be less value to squeeze out of correctness and then the AI labs will start focusing on maintainability. It's probably a lot harder to set up environment to Train for this behavior though.