Remix.run Logo
gonzobonzo 2 days ago

A lot of academia is strongly ideologically biased as well. The training set is going to reflect who's producing the most written material. It's a mistake to take that for reality.

If you trained an LLM on all material published in the U.S. between 1900 and 1920, another on all material published in Germany between 1930 and 1940, and another on all material published in Russia over the past two decades, you'd likely get wildly different biases. It's easy to pick a bias you agree with, declare that the objective truth, and then claim any effort to mitigate it is an attempt to introduce bias.