Well yes of course.

In the old days of computing people liked to say “garbage in, garbage out”.

By that logic, LLMs would be essentially useless considering the amount of garbage that exists on the internet. And, honestly, for things like this they are. But they're not marketed as such, and _that_ is the problem.