LeWorldModel · arXiv:2603.19312LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from PixelsLucas Maes · Quentin Le Lidec · Damien Scieur · Yann LeCun · Randall Balestriero
3D batch-shape explanation
The prediction rope checks the future; SIGReg springs reject a one-point cloud
The shortening orange rope means a better prediction; green springs spread the same batch along multiple directions. The jobs complement each other, but a valid aggregate cloud still does not certify every local tile. Another reading of the spring: no direction crushed, none privileged — fairness to every future readout; and this fairness covers only the distribution, never how distances are read.
Concept · the fairness reading, round twoAnother reading of SIGReg: isotropic N(0,I) means no direction is crushed and none is privileged — any task’s downstream readout finds the space equally usable. It keeps the space fair to every future way of reading it. And this fairness covers only the distribution — it never underwrites how distances are read.
ℒLeWM=ℒpred+λ·SIGReg(Z)
Mechanism highlight · Cramér–Wold查遍所有一维影子 ⇔ 查住整团云:∀u, u⊤Z∼N(0,1) ⇔ Z∼N(0,I)。一个古典定理让“防坍塌”只需要随机方向上的一维正态检验——这正是 SIGReg 的做法。
Motion in three beats① three axes and the collapsed point② the spring expands the cloud; 1-D shadows align to the normal curve③ SIGReg’s act of checking freezes on screen