STATERA: Hidden Mass Estimation via Zero-Shot Sim-to-Real Kinematics using Frozen Temporal Tubelets
STATERA estimates hidden center-of-mass (CoM) offsets of opaque, asymmetric rigid bodies from short monocular videos. It adapts a partially-frozen V-JEPA (video JEPA) backbone with temporal tubelet mixing and a lightweight 2.5D decoder to predict per-frame CoM heatmaps/trajectories. The authors introduce the HiddenMass Benchmark (50K MuJoCo + 63 real sequences). They report improved normalized CoM error in simulation and strong physics capture in zero-shot sim-to-real using phase-aware supervision.
