| ▲ | Tenoke 2 hours ago | |||||||||||||||||||||||||||||||||||||||||||
His main anti-LLM predictions have been consistently either wrong or misleading. There's many ways to skin a cat so you can probably do something with a JEPA approach as well, but I doubt he actually catches up to having agents on the level of where Anthropic/OpenAI will be at any point. | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | onlyrealcuzzo an hour ago | parent [-] | |||||||||||||||||||||||||||||||||||||||||||
His main LLM predictions have almost nothing to do with Arc AGI... What exactly was he dead wrong about that is proven by any of this? GPT getting better has absolutely nothing to do with completely disproving anything LeCun has been saying. He never said LLMs couldn't get better. He never said they couldn't score 7.6% on Arc AGI 3. He's merely said they don't think, and you probably want something that actually thinks if you want a model that can be trained cheaply on a small amount of data and provide a ton of value. Spending $5B to train a model that scores better than an older model does not disprove any of that in any way. | ||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||