Remix.run Logo
varjag 3 days ago

Training is a loan word used to describe human learning process. For a reason.

andix 3 days ago | parent [-]

Humans learn on the job. LLMs don't. Very important difference.

varjag 2 days ago | parent [-]

Where do LLMs learn?

andix 2 days ago | parent [-]

They get trained before release. On general information. But they don't improve while working on very specific tasks. Every new session is like an experienced human on their first day at a new job.

varjag 2 days ago | parent [-]

When they get to you it's only inference. You have basic misunderstanding of what ANNs are.

They train on a billion "jobs". Which is not terribly efficient but oh man they do train.

andix 2 days ago | parent [-]

Unique skills and jobs do exist. And LLMs can't gain additional knowledge "on the job" like humans can. They are generalists, that can only be steered by prompts, skills and context. Thats all I'm saying.

This fact is currently the most limiting factor for LLMs.