109M JEPA Beats 72B Qwen: LeCun Shows Pairing Strategy Trumps Scale for Alignment
LeCun and Balestriero prove image and text models trained on different views of the same scene align via a single rotation; a 109M text JEPA outperforms 72B Qwen on image-text alignment by pairing captions of the same image instead of next-token prediction.
