Remix.run Logo
▲ CuriouslyC 20 hours ago

The point of stochastic parrots is they're just repeating things they've been pre-trained on, but RLVR pipelines teach the model to be good at "trying stuff" as part of an ad-hoc search algorithm.

▲jdub 19 hours ago | parent [-]

"stochastic parrot" is a metaphor, not an analogy

RLVR isn't magic, it just bends some numbers

chain-of-thought isn't magic, it just bends some numbers

▲stymaar 19 hours ago | parent [-]

> “stochastic parrot" is a metaphor, not an analogy

It used to be an apt description, but not anymore.

> RLVR isn't magic, it just bends some numbers

So is all machine learning, but it turns out if you bend them well enough you can get very powerful capabilities.

And also that's enough to say they aren't just trained on repeating what's in their training data, which is the reason to call them “stochastic parrots” in the first place.

And their capabilities have vastly improved since we've started doing it.

▲GoblinSlayer 7 hours ago | parent [-]

So can they now learn from each other?

▲stymaar 7 hours ago | parent [-]

Depends what you call each-other, but kind of: at least they learn from the failures and sucesses of their ancestor during the RL training pipeline.

(Like how AlphaGo learned to play Go in a way that no human ever did, just by playing against “itself”).