Remix.run Logo
▲ davidguetta 2 hours ago

general training remove noise

▲magicalhippo 2 hours ago | parent [-]

I wonder if it's also that it gives them a better sense of analogies. In my experience small LLMs do really poorly with analogies, but the large frontier models seem to get them much, much better.

In math at least I often use analogies to help solve problems, like "ah maybe if I think of this as a vector I might use linear algebra here" and such.