| ▲ | bonoboTP an hour ago | |
That's true in the same sense as "There is nothing qualitatively different about erroneous vs non-erroneous output" for a dog vs. cat image classifier. | ||
| ▲ | user43928 an hour ago | parent [-] | |
To be fair, I guess the line is blurry between what could be labelled a regular mistake compared to a hallucination. "Test suite passed" when it actually errored? Obvious hallucination, unless it ran a command that returned the wrong error code. But is running a malformed command that does not achieve the expected effect itself a hallucination? | ||