| ▲ | tdeck 14 hours ago | |
> Beyond the false answers, the AIs provided specious sources to support their responses to more than half of the questions. In reply to the 400 questions posed to the AIs, they provided 419 sources that included: > 104 webpages that don’t exist, including 86 URLs that show no evidence of ever existing in the Internet Archive or Google. > 77 sources that don’t answer the question. > 18 sources that are completely unrelated to issue at hand. > 15 sources that assert the polar opposite of the answers provided by the AIs. > 13 sources that are demonstrably false. Honestly this is more frustrating than the inaccuracy. Even when you cajole the LLM into "relying on" and "providing" a source they are often wrong or nonexistent. It's not that these sources are unreliable but they simply don't exist or aren't related in any way. | ||