Digest

Reset

1167 papers

2026-11-13 · arXiv:2611.14815

BirdDreams: Joint Perspective and BEV Video Generation for a Plausible, Reactive Driving World Model

Junyoung Seo, Jaewoo Seo, Seungryong Kim et al.

BirdDreams is an autoregressive driving world model that jointly generates perspective video and a schematic metric bird’s-eye-view (BEV) video. It trains on synchronized RGB–BEV pairs rendered from annotations and uses the predicted BEV as a geometric interface to condition ego-trajectory rollouts without HD map or vehicle-state inputs at inference.

DrivingAI summary
2026-11-13 · arXiv:2611.14880

FOE-Dreamer: Deployment-Efficient Learning of Cyber Defense Policies in Operational Networks

Yinuo Du, Christopher Kiekintveld

FOE-Dreamer is a model-based RL framework for cyber defense that trains online and directly in an emulated operational network on cloud infrastructure, without a simulator stage. It uses a factored world model separating defender-driven, exogenous user activity, and opponent dynamics inferred from defender-observable signals. On an 8-host OpenStack testbed with GHOSTS user emulation and two scripted attacker profiles, it trains in 3 days on a single GPU and reduces episode loss by about 2× vs Rainbow and IQN under matched compute.

Latent DynamicsAI summary
2026-11-13 · arXiv:2611.14955

The Posterior-Prior Epistemic Gap: When World Model Imagination Fails to Carry Task-Relevant Signals

Jaerock Kwon, Elahe Delavari, Donghyun Kim et al.

The authors report a measured posterior-prior epistemic gap in an RSSM world model with active-inference planning for CARLA driving: an obstacle probe scores AUC 0.85 on observation-filtered posterior states, but decays on imagined prior states to AUC 0.71 after 15 imagination steps (57% logit-separation decay). Obstacle avoidance stays at 0% without privileged runtime coordinates and ensemble epistemic disagreement fails to flag the loss.

DrivingAI summary
2026-11-13 · arXiv:2611.15009

From Forecasting to World Modeling: Can Temporal Foundation Models Recover Causal Response?

Juwon Hong, Minha Hwang, Venkatesh Shankar

The authors evaluate released temporal and causal foundation models for retail demand, asking whether good forecasting implies correct causal response to price changes. They report that forecast accuracy does not indicate accuracy of predicted price effects (on simulated data with ground truth and on real sales direction). Extra context improves forecasts but not counterfactual price response under confounding. Instrumental variables help only when supplied in a specific form (residuals).

DrivingAI summary
2026-11-13 · arXiv:2611.15011

Fast Inference-Time Policy Refinement via Action-Affine World Models

Run Wang, Yilin Mo, Liang Wu

The authors propose an action-affine world model (A²WM) for fast inference-time refinement of a frozen imitation policy. Given interaction history and a policy action proposal, A²WM predicts a nominal trajectory plus a linear response to action corrections over the full horizon. This enables quadratic-program (QP) refinement with one model evaluation and one QP solve per step, without updating policy/model weights. Across four simulated manipulation tasks, it reports the highest success rate among evaluated refinement baselines.

DrivingAI summary
2026-11-13 · arXiv:2611.15048

Does Your World Model Know Actions Have Consequences?

Ayush Gaggar, Jared Berry, Todd D. Murphey

The authors argue current embodied world-model evaluation misses how well action-conditioned dynamics predict counterfactual consequences. They introduce an Action Perturbation (AP) sensitivity metric comparing predicted vs true impulse responses under forced action perturbations. Using frozen TD-MPC2 components and finetuned dynamics heads trained with different data-collection regimes, they show noise-injected heads improve action sensitivity while workspace raster performs worst.

Latent DynamicsAI summary
2026-11-13 · arXiv:2611.15082

Prediction or Persistence? What Future-Prediction Scores Miss About World Models

Animesh Maheshwari

The authors argue that “future-prediction” scores for pretrained video world models mix encoder quality, near-future similarity to the recent past, and the predictor’s own contribution. They add a matched persistence control (predictor replaced by identity) and show predictor contribution can be positive, small, or negative even when the original score is high. They recommend reporting future-prediction scores with their persistence baseline.

2026-11-13 · arXiv:2611.15131

Duo: A Reciprocal World Model for Full-Duplex Interaction

Hengyuan Cao, Biao Gong, Guoshan Lu et al.

The authors introduce the Reciprocal World Model (RWM) and Duo v1, a full-duplex world model that continuously perceives real-time audio, video, and text while responding in real time. Duo v1 uses a chunk-wise setup with an Autoregressive Intent Module for participation decisions and a causal audiovisual Realization Module that generates audio/video latents conditioned on intent, synchronized on a unified timeline. They train in stages and distill for live interaction.

Video World ModelsCode availableAI summary
2026-11-13 · arXiv:2611.15143

Multi-View 3D Reconstruction Using V-JEPA Features

Anwar Shamim, Jeffrin Sam

The authors study supervised RGB-only multi-view 3D reconstruction using a downstream architecture initialized from a V-JEPA 2.1 encoder. They compare global vs spatial camera estimation and a joint relative-objective configuration on CO3D (five-view windows) and an independently trained TUM RGB-D setting. Results show mixed gains: spatial cameras improve CO3D absolute trajectory error but hurt trajectory/depth relative to identity/global; relative objectives improve calibrated/aligned-shape metrics but worsen raw reconstruction.

Video World ModelsCode availableAI summary
2026-11-13 · arXiv:2611.15215

AFTER: A World Model with Adaptive Fast--Slow Timescales for Error-Driven Retention

Haoyi Zhang, Qi Zhang, Yunfan Ren et al.

AFTER-WM is a world model for online dynamics adaptation under sudden, persistent, initially unknown changes. It uses predictive correction from one-step prediction errors plus dual-timescale fast/slow adaptation (with fading fast correction and persisting slow correction) and multiple pre-trained experts whose combination weights are adaptively reweighted without altering experts. On five simulated robot datasets and real UAV data, the authors report lower multi-step mean error and the highest mean return in a joint-failure control task.

RoboticsAI summary
2026-11-13 · arXiv:2611.15238

Towards Robust Vision-Language Reasoning: A Multi-Stage Optimization Pipeline with Masked Diffusion Model

Shunming Liu, Pei Huang, Yajing Sun et al.

The authors propose a multi-stage optimization pipeline for discrete diffusion vision-language models in autonomous driving, covering (1) trajectory discretization in supervised fine-tuning to suppress hallucinations, (2) metric-guided diversity filtering during reinforcement learning to improve exploration, and (3) Dynamic Autonomous Driving Decoding (DAD) at inference to adapt decoding order by scene complexity. They develop Masked Diffusion Drive (MD-Drive).

DrivingAI summary
2026-11-13 · arXiv:2611.15260

Driving World Models Move the Camera, Not the Scene

Yuqiao Feng, Xiaoyu Ao

The authors report that plan-conditioned driving world models typically move the camera but barely move the scene: their scene response to speed or lateral plans reaches at most about a third of real-video response (and at most a quarter for a 0.54 m lateral shift). The trajectory ADE score can’t distinguish executing vs ignoring speed commands due to scale alignment. They propose ReTime-Compose, which delivers the plan as geometry without training.

DrivingAI summary
2026-11-13 · arXiv:2611.15296

APG-Planner: Learning Vision-Based High-Speed Trajectory Planning via Analytic Policy Gradient

Jinwoo Lee, Geunsik Bae, Changseung Kim et al.

APG-Planner is a vision-based high-speed trajectory planner trained with analytic policy gradients (APG). The method uses differential flatness to analytically reconstruct vehicle states from planned trajectories, enabling differentiable trajectory-level state transitions without explicitly modeling low-level dynamics. The resulting differentiable episode rollout supports backpropagation through the planning sequence and avoids noisy sample-based policy-gradient estimation. After ~30 minutes of training on a single GPU, it reaches up to 11 m/s in real flight.

DrivingAI summary
2026-11-13 · arXiv:2611.15360

CARE-Drive: Coupled Alternating Refinement for Ego-trajectories

Xiao Ma, Yijun Chen, Zhiquan Hu et al.

CARE-Drive (Coupled Alternating Refinement for Ego-trajectories) refines ego trajectories by separating waypoint residual correction from position-conditioned heading generation. A future-token auxiliary task trains a predictive VLA backbone; then, with the backbone frozen, two specialists are optimized alternately (supervised initialization + reinforcement fine-tuning). On NAVSIM v1, the authors report 88.8 PDMS, +2.4 over the unrefined backbone.

DrivingCode availableAI summary
2026-11-13 · arXiv:2611.15368

Bind-WAM: Binding-Uncertainty-Guided Selective Future Imagination in World Action Models

Chenhao Qiu, Shuyi Chen, Songen Gu et al.

Bind-WAM is a world action model that imagines future only when needed. It uses language-object binding uncertainty—supervised by an offline labeling pipeline that detects reference mismatch, invisibility, and identity drift—to route between direct action prediction and joint future-action denoising. Simulation and real-world experiments show binding uncertainty as an interpretable signal for selective future imagination, with reduced task completion time.

DrivingAI summary
2026-11-13 · arXiv:2611.15523

An Approach to Hinton's Mother-Child Proposal: Neural Networks Learning and Preserving Care in a Finite World

Csaba Balogh

The authors propose “care” that is learned before the network’s own reward matters, and studies whether it survives the mother’s departure, new situations, and further learning. The mechanism uses a fixed harm vocabulary, a learned future acceptability measure, and an execution veto via a learned gate plus role certificates to transfer within a declared world family. They give preservation theorems with explicit conditions and test water/speech experiments.

AI summary
2026-11-13 · arXiv:2611.15585

Marginal-Preserving Coupled Diffusion Composition for Long-Horizon Planning

Hengrui Zhang, Qiyu Wang, Yuhu Cheng et al.

The authors propose MCDC, a training-free inference modification for pretrained compositional diffusion planners. Instead of sampling chunk initial noises independently, MCDC samples coupled Gaussian initializations with exact per-chunk standard-Gaussian marginals while inducing positive cross-chunk correlation on neighboring chunks, improving overlap-mode compatibility and long-horizon stitching coherence.

2026-11-13 · arXiv:2611.15602

CoCode-World: Shared 3D Proxy Representation for Multi-Player World Models

Qirui Li, Xin Zhang, Yabo Chen et al.

CoCode-World is a shared 3D proxy framework for joint two-player video generation. It uses programmable, textureless 3D proxies for layout/motion/occlusion and an RGB appearance reference for characters and scene style. The two players’ proxy videos and appearance evidence are concatenated into one context, and a pretrained video model is adapted with LoRA so native attention enables cross-view communication and consistent player identity.

2026-11-13 · arXiv:2611.15689

What World Model Does Active Object Search Need? A Study under Imperfect Detection

Kyeongryeol Go

The authors introduce Bayesian Active Miss-aware Object Search (BAMOS), a belief-based world model for active object search under imperfect detection. It predicts detection likelihood (not full scene reconstruction) using a target belief (location+size), an occupancy belief (for visibility), and fitted detector error rates. Ablations in Isaac Sim and HSSD show target belief and its update mechanisms are critical, with contributions growing as detector errors increase. Code is available.

DrivingAI summary
2026-11-13 · arXiv:2611.15744

Latent Imagination for Parameterized Action Spaces

Atahan Cilan, \.Ihsan Mert Muhac{\i}ro\u{g}lu, \"Umit Can Bekar

HyLI is a model-based PAMDP agent that learns a hybrid mode-and-parameter policy entirely in the latent imagination of a DreamerV3-style world model and acts with a single forward pass. It uses counterfactual mode evaluation (CME) and success-window replay (SWR) to address PAMDP-specific learning issues. On seven PAMDP benchmarks, it matches or nears the strongest model-free baseline and is much faster than the planner DLPA.

Latent DynamicsAI summary