Yesterday I asked one LLM about certain provisions of Ukrainian law, where severity threshold for a financial crime was specified indirectly through a certain well known constant. The machine got it wrong and when asked to give sources cited the respective law referencing a similary sounding unit. Amazingly it gave the correct English tranlation but gave me the wrong original in Ukrainian.

I guess it merged two tokens why learning the text.

Amazingly it also knows about difference between two constants, but referrs to the wrong one in both calculations and in hallucinating the quote.

It's tedious to always check for stuff like this.

Then I asked a different LLM and it turned out that actually the constant is monkey patched for specific contexts and both me and the first lying machine were wrong