If the whole British Post Office Scandal (Fujistu, btw) in the UK wasn't enough, nothing will be. People literally killed themselves over the accusations/convictions that were 100% false. One of the major people responsible was an Anglican Priest(!) of all people who was so sure that the Computer Is Right... [0]

We're headed for even rougher times if LLMs are going to be taken "at their word".

[0] Now, watching her testimony, it seems she was willfully complicit and it's a disgrace that she isn't in prison, but that's tangential. The "system" was responsible, but without personal accountability, nothing will change. So it goes.