Remix.run Logo
RugnirViking 7 days ago

It is trained to practice chemistry and law. The reason it can do those because it's trained on an appreciable portion of all human output on both or those fields. If that's not training on them I don't know what is.

lostmsu 7 days ago | parent [-]

> It is trained to practice chemistry and law

No, it is not. It is trained to predict next token, and it is trained to follow user instructions.

RugnirViking 6 days ago | parent [-]

I mean, it a very literal sense, it is. Chemistry and law textbooks are in the training corpus. It is trained on these

lostmsu 5 days ago | parent [-]

This sounds backwards to me. The fact that I can show you a law book and you will be able to pass a law exam is a consequence of you being "generally intelligent". If I show these books to something less intelligent like a cow, or less general, like a CNN, they won't be able to do that.

RugnirViking 5 days ago | parent [-]

no, you're not understanding me. I'm not making any claim on whether they're any good at those subjects, merely that they are, objectively, trained on them

lostmsu 5 days ago | parent [-]

What is the relevance of this claim on its own if training on something alone is not sufficient for them to practice law, and you actually have to add cross-domain into picture for it to work, making it "general"?

I still disagree though, they are not trained to practice law. They are trained to remember law, but practice come from general training to follow instructions.