Papers · Predictions · Physical intelligence

World Models Radar

A significance-filtered record of what actually moved world models forward.

Latest weekly report

World Models Weekly

Significant research, evaluation results, and the evidence behind them.

Read the report

Follow the scientists

Explore the directory →

Track the people behind the ideas and keep their latest Radar papers together.

Danijar HafnerLearning and acting in imaginationYann LeCunPredictive representation learningPieter AbbeelPhysical robot learning and simulation

From the editor’s desk

All editor picks →
2025-01-07 · arXiv:2501.03575

Cosmos World Foundation Model Platform for Physical AI

NVIDIA, :, Niket Agarwal et al.

Cosmos is NVIDIA's platform for 'world foundation models' for Physical AI: a video curation pipeline, pre-trained diffusion and autoregressive world models, examples of post-training for downstream tasks, and video tokenizers, released open-source with open-weight models.

Video World ModelsCode availableEditor pick
2023-09-29 · arXiv:2309.17080

GAIA-1: A Generative World Model for Autonomous Driving

Anthony Hu, Lloyd Russell, Hudson Yeo et al.

GAIA-1 is a generative world model for driving that takes video, text and action inputs, casts world modelling as next-token prediction over discrete tokens, and decodes with a video diffusion model to produce realistic driving scenes with control over ego-vehicle behaviour and scene features.

DrivingEditor pick
2025-06-11 · arXiv:2506.09985

V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning

Mido Assran, Adrien Bardes, David Fan et al.

Pretrains an action-free JEPA video model on over 1 million hours of internet video, then post-trains a latent action-conditioned world model (V-JEPA 2-AC) on under 62 hours of unlabeled robot video and uses it to plan pick-and-place with image goals, zero-shot on Franka arms in two labs.

JEPACode availableEditor pick

Latest discoveries · 1167

Browse the full digest →
2026-11-13 · arXiv:2611.14815

BirdDreams: Joint Perspective and BEV Video Generation for a Plausible, Reactive Driving World Model

Junyoung Seo, Jaewoo Seo, Seungryong Kim et al.

BirdDreams is an autoregressive driving world model that jointly generates perspective video and a schematic metric bird’s-eye-view (BEV) video. It trains on synchronized RGB–BEV pairs rendered from annotations and uses the predicted BEV as a geometric interface to condition ego-trajectory rollouts without HD map or vehicle-state inputs at inference.

DrivingAI summary
2026-11-13 · arXiv:2611.14880

FOE-Dreamer: Deployment-Efficient Learning of Cyber Defense Policies in Operational Networks

Yinuo Du, Christopher Kiekintveld

FOE-Dreamer is a model-based RL framework for cyber defense that trains online and directly in an emulated operational network on cloud infrastructure, without a simulator stage. It uses a factored world model separating defender-driven, exogenous user activity, and opponent dynamics inferred from defender-observable signals. On an 8-host OpenStack testbed with GHOSTS user emulation and two scripted attacker profiles, it trains in 3 days on a single GPU and reduces episode loss by about 2× vs Rainbow and IQN under matched compute.

Latent DynamicsAI summary
2026-11-13 · arXiv:2611.14955

The Posterior-Prior Epistemic Gap: When World Model Imagination Fails to Carry Task-Relevant Signals

Jaerock Kwon, Elahe Delavari, Donghyun Kim et al.

The authors report a measured posterior-prior epistemic gap in an RSSM world model with active-inference planning for CARLA driving: an obstacle probe scores AUC 0.85 on observation-filtered posterior states, but decays on imagined prior states to AUC 0.71 after 15 imagination steps (57% logit-separation decay). Obstacle avoidance stays at 0% without privileged runtime coordinates and ensemble epistemic disagreement fails to flag the loss.

DrivingAI summary
2026-11-13 · arXiv:2611.15009

From Forecasting to World Modeling: Can Temporal Foundation Models Recover Causal Response?

Juwon Hong, Minha Hwang, Venkatesh Shankar

The authors evaluate released temporal and causal foundation models for retail demand, asking whether good forecasting implies correct causal response to price changes. They report that forecast accuracy does not indicate accuracy of predicted price effects (on simulated data with ground truth and on real sales direction). Extra context improves forecasts but not counterfactual price response under confounding. Instrumental variables help only when supplied in a specific form (residuals).

DrivingAI summary
2026-11-13 · arXiv:2611.15011

Fast Inference-Time Policy Refinement via Action-Affine World Models

Run Wang, Yilin Mo, Liang Wu

The authors propose an action-affine world model (A²WM) for fast inference-time refinement of a frozen imitation policy. Given interaction history and a policy action proposal, A²WM predicts a nominal trajectory plus a linear response to action corrections over the full horizon. This enables quadratic-program (QP) refinement with one model evaluation and one QP solve per step, without updating policy/model weights. Across four simulated manipulation tasks, it reports the highest success rate among evaluated refinement baselines.

DrivingAI summary