You don't have to imagine, it will hallucinate you a slop with full confidence every time.

I've already seen at least one person who was pretty sure that the preprint paper they co-authored with AI (read: AI wrote for them) was going to cure cancer and make them billions of dollars.

There was only one problem. The paper jumped straight from "this paper will show how our new treatment could cures cancer forever" to "as you can see, these results clearly show that our treatment cures cancer" - with neither any actual results nor any specifics on the treatment. And I don't just mean that the paper didn't go into details; writing the paper was the full extent of their "research".

AI was used fundamentally for COVID vaccine development. AI is used for research in all modern drugs. It’s a certainty if cancer gets cured AI will have played a fundamental role since it’s already fundamental to precursors.