page 20 ("A thought experiment on alignment and understanding") is perhaps not likely to quite induce the reaction in most people that Mr. Tao expected.

You described my point much better -- totally agree. It also seems he maybe isn't aware of the nature of experimental drugs, which are often given to patients with serious/terminal conditions before they'd otherwise be approved...