> 33M-parameter text JEPA reaches .125 on the PRH paper’s benchmark, against .034 on Flickr captions, level with Qwen2.5-3B and -7B. They need fewer samples.

Im bullish on jepa models. Success of autoregressive next token prediction feels like a stroke of luck.