Plus you'd kill a lot of people.

"You're absolutely right, that drug was lethal and that's on me. I'll add a note to check human toxicity for all compounds in the future. To verify the safe dosage, I'll administer a high dose and then check smaller doses until the patient survives — not guesswork, grounded load-bearing experiments."

That's exactly what Sidney Farber did in Boston Children's Hospital btw in late 1940. One of his tests fast forwarded cancer.

I think its practical to solve cancer on a war footing where we would expect people to die.

And Farber's methods were pretty fast for his time - lol Farber would be a perfect name for this AI that wants to solve cancer knowing what's at risk.