| ▲ | The Annotated JEPA(elonlit.com) | ||||||||||||||||||||||||||||
| 72 points by surprisetalk 5 days ago | 14 comments | |||||||||||||||||||||||||||||
| ▲ | martythemaniak 4 days ago | parent | next [-] | ||||||||||||||||||||||||||||
I ran across this two-part interview with Yann Le Cunn and I thought it gave a pretty good broad overview/background into JEPA: https://www.youtube.com/watch?v=kYkIdXwW2AE | |||||||||||||||||||||||||||||
| ▲ | verdverm 4 days ago | parent | prev | next [-] | ||||||||||||||||||||||||||||
Are there any pre-trained models / implementations of this, like vllm style, or are we still early into this architecture? It looks like LeJEPA is sub-1B params and tested on vision tasks? (https://github.com/galilai-group/lejepa) I had assumed the JEPA family will also be multimodal and agentic capable, perhaps just needs them scaling laws applied? | |||||||||||||||||||||||||||||
| ▲ | feelingsonice 4 days ago | parent | prev | next [-] | ||||||||||||||||||||||||||||
LeCun's new paper takes a new approach to building JEPA, which he named LeJEPA -- https://arxiv.org/abs/2511.08544 It's not that different in the underlying theory but he removes the EMA and the twin tower, makes the whole thing more straightforward. | |||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||
| ▲ | thisisauserid 4 days ago | parent | prev | next [-] | ||||||||||||||||||||||||||||
LeCun's even newer paper takes a new approach to building JEPA, which he named Ada-JEPA: https://arxiv.org/html/2606.32026v1 | |||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||
| ▲ | hoppp 4 days ago | parent | prev | next [-] | ||||||||||||||||||||||||||||
Seems like a pretty good article to sit down and type out the code and spend an afternoon learning. | |||||||||||||||||||||||||||||
| ▲ | preetham_rangu 4 days ago | parent | prev | next [-] | ||||||||||||||||||||||||||||
[flagged] | |||||||||||||||||||||||||||||
| ▲ | levocardia 4 days ago | parent | prev [-] | ||||||||||||||||||||||||||||
100% AI-generated. Yawn. | |||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||