Not the GP, and this is just the free ChatGPT, not a frontier model, but just a few days ago it happily confabulated an entirely incorrect version of the plot of Iain M. Banks’s "Matter" when I asked it to analyze the novel in a certain context. Claude fared better, though it also made some mistakes. I don’t expect the models to know or recall the specifics of the plot of every novel out there, but it would be nice if they didn’t make things up.

[dead]