Olmo author here! Your are absolutely spot on on

> It was impossible for me to actually fact-check any of the claims in the response based on the matched training data.

this is true! the point of OlmoTrace is to show that even the smallest phrases generated by a langue model are a product of its training data. It’s not verification; a search system doing post hoc checks would be much more effective

Thanks for the reply! Olmo is fascinating, and beyond the traceability aspect, I really appreciate that you all are releasing true open source models complete with data, training code and weights.

I was too dismissive in my comment—even if it's going to be a longer journey, the first step is still tremendously valuable. Thank you!