Latent-Foresight: End-to-End Learning Predictable Representations for Latent World Models
Latent-Foresight is an end-to-end framework that jointly learns a latent tokenizer and a flow-based generative dynamics model for forecasting in VFM feature space. It avoids two-stage pipelines by shaping the latent space for temporal predictability, using design choices to prevent latent collapse (stop-gradient targets/noisy inputs, latent normalization, auxiliary reconstruction on denoised latents, and noise scheduling). The authors report consistent gains over prior two-stage baselines across multiple tasks and horizons.
