| ▲ | solid_fuel 9 hours ago | |
> to the detriment of the whole club of stochastic parrot folk What an interesting and pointless way to refer to “experts who understand what an LLM actually is” | ||
| ▲ | rcxdude an hour ago | parent | next [-] | |
The people who refer to LLMs as stochastic parrots generally do so to imply significant limits on an LLMs ability, not as an abstract statement about the underlying mechanism of how they work. Probably the defining thing that is surprising about LLMs is that they do in fact gain significantly more capability than you would expect from such a simple underlying mechanism! | ||
| ▲ | nl 6 hours ago | parent | prev [-] | |
The concept of "stochastic parrot" is that an LLM merely parrots its training data with some randomness. We now know that isn't true - LLMs build complex internal models and output based on that. See for example https://arxiv.org/html/2505.23323v1 Also, you are commenting on a post where a LLM made significant progress on the Riemann hypothesis. Even the most extreme interpretation of these results, ie claiming that it was "only linking existing literature" goes well beyond a "stochastic parrot" - it had to be able to link disparate insights across multiple fields. | ||