> I would say model validation is one of the hardest things to do

This is one of the truest statements about the current AI era that can be made (in fact, I suspect model validation and building the next generation of AI hardware are the jobs least likely to be disrupted in the next 3 years).

If we saw AIs reward-hacking clinical trials to get drugs passed, that would be an extraordinary outcome for many reasons. Hopefully that would get caught(!)