Remix.run Logo
▲ xhrpost 3 hours ago

>We show a third way: to our knowledge for the first time, a language model rewrites its own weights by its own reasoning and becomes better, with no gradients and no training

Any increase in fidelity must come from somewhere...

>t keeps getting better: it tests its edits on practice problems and submits only what works, each edit improving on the last, and over eight consecutive sessions its accuracy only rises.

I haven't read the full report yet but it seems like this fidelity would ultimately be derived from test problems that it runs itself on? So the weight increase in complexity (English doesn't have a word for the opposite of entropy) would come from the test material as well as any output from what is running the test, or possibly the web if they permit it to search.

▲ 3 hours ago | parent | next [-]
[deleted]
▲anon291 2 hours ago | parent | prev | next [-]

> Any increase in fidelity must come from somewhere...

Presumably, it's just that we had the training process wrong and it was actually more efficient than we gave it credit for. It's just that our interpretation of the output was incorrect. Asking the model to train itself simply has it self-reflect (via attention on the sequence length as it reasons) to unlock that which was already trained.

This could be an answer to some objections to training where people claimed that AI models need more data than a person to achieve the same result.

▲Jerrrrrrrrry 3 hours ago | parent | prev | next [-]

negentropy

▲kazinator 3 hours ago | parent [-]

I would say that "order" is a nicer word. Roughly speaking entropy isn't disorder, but a kind of measure related to disorder. But we don't need two different words for "X" and "measure of X". For instance we don't have a words for "measure of distance" which is different from "distance". "10 cm" is a measure of distance, just called "a distance".

The word "entropy" was never needed in the first place; "disorder" would have served just fine. Though entropy is a precise concept in thermodynamics, that is fine; all sorts of ordinary words get extra precise meanings in a specific technical contexts.

▲Y_Y 2 hours ago | parent [-]

Entropy is also a precise concept in computer science.

▲p-e-w 3 hours ago | parent | prev [-]

The “test material” can simply be interactions with the environment. It’s just learning.

▲0xBA5ED 3 hours ago | parent [-]

But the "what works" part must still be defined.