|
| ▲ | dgacmu 5 hours ago | parent | next [-] |
| Oh, that's interesting - good point, since it's filtered and not trained from scratch. My prior would be to assume it's just bs'ing as LLMs usually do but it seems worth exploring. |
|
| ▲ | parasti 4 hours ago | parent | prev | next [-] |
| "I don't know" isn't in the training data. Nobody writes engineering books, science papers and blog posts that end with "well, I don't really know, the end". |
| |
| ▲ | HPsquared an hour ago | parent [-] | | A bit like publishing bias where only positive results end up in scientific papers. |
|
|
| ▲ | danaris 3 hours ago | parent | prev [-] |
| The LLM doesn't "know" anything, can't reason about its own knowledge, and has no self-awareness. It has training data, and it can use your prompts to synthesize that training data into probable continuations or responses. If the training data doesn't include lots of text of people being asked questions and saying "I don't know", then it's unlikely to respond "I don't know" when prompted, regardless of whether anything in its training data that might actually answer your question. |
