*twitch*

I also like when it says "this is a known issue!" to try and get out of debugging and I ask for a link and it goes "uh yeah I made that up".

Right, because in the training set, text like that is often followed by the text “this is a known issue!”.

That’s a great example to use to explain to people why these things are not actually reasoning.

Or drops citation links into its response, but the citations are random things it searched for earlier that aren't related to the thing it's now answering.