LeCun and Balestriero Publish JEPA Paper: 109-Million-Parameter Model Surpasses… in Cross-Modal Representation Alignment
Yann LeCun and Brown University assistant professor Randall Balestriero have published a 37-page paper, "Proving and Improving the Platonic Representation Hypothesis with JEPAs," proposing that under positive-sample relationships meeting specific conditions, JEPA models of different modalities can learn representation spaces that differ only by a rotation transformation. In experiments, a 109-million-parameter text JEPA scored 0.184 on the cross-modal representation alignment metric, higher than Qwen2.5-72B's 0.154 and Llama-3-70B's 0.151, but this metric measures the closeness of representation structures, not general capability. The research also claims that Good Views training reaches the alignment level of next-token prediction with 900 million samples using about 21.6 million samples, a gap of roughly 14 times when calculated by token count.
#Papers/Research#English text is being prepared.#Multimodal