> How would the LLM "know" which of these novel findings were in any way meaningful

Given that they are trained on all of arXiv, ..., it's much more likely they are aware of all public relevant papers than your average researcher.

A researcher on any particular topic is not supposed to be an "average" researcher, but already deeply familiar with their subject.