Digest

Reset

122 papers

2026-11-11 · arXiv:2611.13182

Making Strides in Symbolic Imitation Learning: Offline Demonstrations, Online Tuning

Bryce MacInnis, Malcolm I. Heywood

The authors propose Symbolic Imitation Learning: distill an oracle policy from an offline dataset into a decision list over if-elif-else rules that deploy linear “motion primitives,” discovered via an EM-based discretization of continuous actions. They then fine-tune thresholds/constants and linear model parameters online using Augmented Random Search (ARS). They report matching oracle performance across 20 RL tasks and exceeding it in 11.

DrivingAI summary
2026-11-11 · arXiv:2611.13203

Audited Gradients, Anchored Policies: Model-Based Reinforcement Learning for Efficient Flow Control

Ruige Kong, Stefania Fresca

The authors address a failure mode in pathwise model-based RL for flow control: a differentiable surrogate can track flow trajectories yet misestimate the action gradient used for policy optimization. They audit surrogate action gradients against high-fidelity central finite differences on held-out states, then fit an extracted low-dimensional feedback law from audited gradients and initialize/anchor a neural policy. Tested on four flow cases, their controllers outperform or match a model-free baseline using 3–156× fewer high-fidelity solver interactions.

DrivingAI summary
2026-11-11 · arXiv:2611.13229

Incorporating World Models in Decision Making for Next Best View Selection in Active Sensing

Nikita Sarawgi, Omey M. Manyar, Satyandra K. Gupta

The authors present a deployment adaptation method for next-best-view (NBV) selection that reuses a fixed action-conditioned world-model predictor but learns a local sensor-return adapter from limited calibration data. The adapter estimates measurement dropout over predicted surfaces and filters candidates accordingly. On a real robot with a structured-light sensor, deployment-aware selection achieves higher measured surface coverage with 60% fewer captures than nominal selection.

DrivingAI summary
2026-11-11 · arXiv:2611.13348

ProTEUS: A mutation-resolved world model for closed-loop protein evolution

Yikun Zhang, Minghao Guo, Guangxue Xu et al.

ProTEUS is a mutation-resolved world model for closed-loop protein evolution. Pretrained on deep mutational scanning, it learns a joint latent representation of sequence, evolutionary, and structural information with MutationFormer, where mutations are actions and predicted outcomes guide exploration. It also uses a fast physics-constrained all-atom predictor, and refines via closed-loop experimental feedback. The authors report improved mutation prediction and >10× activity over wild type in two engineering campaigns.

Latent DynamicsAI summary
2026-11-11 · arXiv:2611.13528

GEMOR-GS: Global Extrinsic-calibration-refined Mapping and Online Relocalization for 3D Gaussian-Splatting SLAM

Yuchen Yang, Ming Ding, Xinyu Wu et al.

GEMOR-GS is a LiDAR–inertial–visual SLAM system that upgrades a 3D Gaussian splatting (3DGS) map into a geometrically accurate, globally refined, and re-enterable world representation. It estimates LiDAR–camera extrinsics offline via direct-method alignment and reuses them. Offline refinement alternates gated differentiable rendering with LiDAR-projection objectives, followed by global reconstruction with online constraints lifted. For tracking loss, it relocalizes via an XFeat bypass map, RANSAC-PnP, and Gaussian RGB-D warp refinement.

DrivingCode availableAI summary
2026-11-11 · arXiv:2611.13572

Market-Conditioned JEPA: Learning from Unpredictable Market Shocks

Yuqi Wang, Fengyuan Liu, Mukai Li et al.

The authors introduce Market-Conditioned JEPA (MC-JEPA), a joint-embedding predictive model for financial time series that conditions training prediction on a market factor constructed from other assets’ future embeddings. In a latent factor model, conditioning makes exposure necessary for optimal prediction and reduces noise in learning asset-specific signals. On 11 years of minute-level Chinese A-share data, MC-JEPA improves ridge-probe RankIC and trading backtest metrics over per-asset JEPA.

JEPAAI summary
2026-11-11 · arXiv:2611.13592

Few-Shot Residual Adaptation of Pretrained Latent World Models

Jakub Suliga, Pankhuri Vanjani, Nisarga Nilavadi et al.

The authors study few-shot residual adaptation for pretrained latent world models under physical dynamics shifts. They keep the pretrained DUET-DINO/DINOv3 components frozen and learn self-supervised residual corrections from latent prediction errors, applied both inside the latent predictor and to its predicted latent state. On a real robot with center-of-mass and friction shifts, frozen success drops near zero; with three adaptation episodes, dual-site recovers 90% (CoM) and 100% (friction).

Latent DynamicsAI summary
2026-11-11 · arXiv:2611.13818

WAM is capable in BEHAVIOR-1K: the 2nd-place solution to the 2026 BEHAVIOR Challenge

Yelin He, Jiaquan Ye, Xinming Wei et al.

The authors present the 2nd-place Team IF1001 solution to the 2026 BEHAVIOR Challenge (mobile manipulation over 100 household tasks). The method is built on Cosmos 3 as a world action model (WAM) and improved with richer visual history, task-progress estimation, task-group and skill-specific LoRA adapters, plus inference-time routing and execution strategies. The system achieves 0.615 mean Q-score and 41.2% full-task success on the official private test set.

2026-11-11 · arXiv:2611.13819

Game-Enhanced Embodied Learning with Event and Foresight Pretraining

Lianlei Shan, Han Jin, Yaunchao Ma et al.

The authors report event-and-foresight pretraining for InternVLA-A1.5 using 394 human gameplay recordings across 20 games. After 12,400 game-pretraining updates, they compare a transferred checkpoint against the public base using the same suite-specific robot fine-tuning. Across four LIBERO suites, aggregate success increases from 1,718/2,000 (85.90%) to 1,811/2,000 (90.55%) (+4.65 pp), with heterogeneous task outcomes.

DrivingAI summary
2026-11-11 · arXiv:2611.14048

LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning

Xuheng Zhang, Yiming Zhang, Jialin Gao et al.

LaST 0.5 is a world action model for robotic manipulation that learns interaction-centric latent reasoning between world modeling and action generation. It uses a Mixture-of-Transformers with a world expert, a latent expert supervised by visual interaction cues, and an action expert. It also introduces AWAT to adapt the action execution horizon using predicted progress consistency. Pretraining uses 14k+ hours of robotic data.

RoboticsAI summary
2026-11-11 · arXiv:2611.14186

Koopman Model-Based Reinforcement Learning

Wenjian Hao, Paulo C. Heredia, Shaoshuai Mou

The authors propose Koopman model-based reinforcement learning (K-MBRL) for controlling nonlinear robotic systems with unknown dynamics. K-MBRL learns a stochastic deep Koopman model for dynamics in a linear lifted representation and a critic for future cost. It approximates the policy objective using immediate cost plus one-step predicted-state value, aiming to reduce rollout prediction error accumulation and enable real-time feedforward control without online optimization.

RoboticsAI summary
2026-11-11 · arXiv:2611.14257

Elastic-WAM: Adaptive Spatiotemporal Imagination for Efficient Robot Control

Haitian Li, Tianfu Li, Xuxi Zhao et al.

Elastic-WAM adapts the amount of future-world refinement during robot control by learning a unified spatiotemporal “refinement demand” field that decides when to stop, how far to advance denoising, and which future video regions to refresh. It uses a frozen WAM backbone with action-grounded supervision and recurrent sparse world refinement at inference.

DrivingAI summary
2026-11-11 · arXiv:2611.14286

ForeseeDrive: Future-Token Conditioning for Anticipatory Generative Driving

Shaokai Wu, Xunchu Zhou, Pinzhi Wang et al.

ForeseeDrive predicts compact, query-indexed future tokens from present context and uses them to condition a generative driving planner before candidate materialization. The tokens are derived from logged future actor motion, occupancy evolution, route interactions, and TTC margins. A zero-token-gated residual adapter, candidate preservation, and a TTC-margin guard constrain drift and brittle safe-to-unsafe boundary crossings.

DrivingAI summary
2026-11-11 · arXiv:2611.14365

From Video Frames to Robot Meta-Frames: A Unified Latent Interface for World Action Models

Guoqiang Liang, Yiqi Lin, Yanzhe Chen et al.

MetaWAM is a world action model that injects robot signals (proprioception, actions, values, task type) into a single unified “meta-frame” for a pretrained video diffusion model. Instead of separate latent frames or learned encoders/decoders, it packs signals into disjoint DCT frequency channel bands and lifts them via inverse DCT. On RoboCasa it reports 68.9% success and reports 39% lower inference latency; it reports 85.0% success on three real-world Franka tasks.

RoboticsCode availableAI summary
2026-11-11 · arXiv:2611.14383

An Energy-Based Perspective on Machine Learning

Bo Dai, Yilun Du

The authors present a tutorial using energy-based models (EBMs) as a unifying lens. Any EBM is defined by its energy (what it represents), its inference procedure (sampling or optimization), and its learning method (how it fits data). They argue many discriminative, generative, representation, and planning/RL methods can be cast as EBMs that mainly differ in partition-function handling and sampling, and they suggest new algorithms via component substitution and energy composition.

AI summary
2026-11-11 · arXiv:2611.14419

Evaluating LLM-Generated World Models for Neuro-Symbolic Reasoning

Souhaila Djaffal, Amna Jamal, Gagana Madhugiri Devaraja et al.

The authors evaluate whether five LLMs can generate executable world models as partially observable stochastic games (POSGs) from natural-language scenarios. They introduce a 44-scenario benchmark and a three-lane evaluation (mechanical validity, reference-relative structural agreement, and semantic checks). In the reference-backed game track, 134/135 pass a strict mechanical audit, but mean permutation-invariant structural F1 is only 0.366, and just 28/134 exactly match the authored reference.

Latent DynamicsAI summary
2026-11-11 · arXiv:2611.14420

OnlyAct: Extracting Action Representations from Foundation Models for World Models

Runjia Li, Minghao Chen, Junyu Xie et al.

OnlyAct extracts action representations from a pretrained video foundation model (V-JEPA 2) using label-free contrastive adaptation. It constructs positives by keeping motion while swapping scenes (flow-guided cut-and-paste) and uses hard negatives from the same video with different motion. The adapted encoder conditions an action-conditioned autoregressive video world model, enabling action transfer and real-action control on robot, camera-navigation, game, and driving benchmarks.

2026-11-11 · arXiv:2611.14496

RS-JEPA: Remote Sensing Joint-Embedding Predictive Architecture with Scan-Path Views for Cross-Sensor Image Retrieval

Tanishq Rachamalla, Srishti Kaushik, Muhammad Attique Khan et al.

RS-JEPA is a compact, label-free cross-sensor image retrieval method that uses a shared Vision Mamba encoder and scan-path views: two reading orders of the same image are treated as self-supervised views, predicting hidden patch features from visible ones. It adds Adversarial View Coupling (AVC) to make prediction harder and a neighbourhood consensus loss to align cross-sensor similarity geometry. The authors report the highest F1@5 among twelve re-implemented methods.

JEPACode availableAI summary
2026-11-10 · arXiv:2611.10013

From Video to Digital Twin: An Exploratory Study of World Models and Gaussian Splatting on In-the-Wild Video

Somesh Mohapatra

The authors study generative world models and locally optimized 3D Gaussian splats on an uncurated in-the-wild news walkthrough of a food bank warehouse (20 frames for a commercial world model). The world model recovered camera poses and metric depth for three areas and fused them into ~747k Gaussians. Held-out novel-view PSNR drops when training uses only 8 frames, and locally trained splats degrade quickly away from the filmed path. Generating unseen views failed on the provider side twice.

2026-11-10 · arXiv:2611.10151

WorldMind: Test-Time Scaling for Visual Spatial Reasoning through Latent World Simulation

Haoming Wang, Yongjian Fu, Ju Ren et al.

WorldMind is a test-time scaling framework for visual spatial reasoning that performs iterative “latent world simulation.” A VLM selects spatial transformations; a world model executes them and returns aligned intermediate latent features directly to the VLM, avoiding repeated decode/re-encode through RGB. The authors train latent selection/alignment, then fine-tune with simulation-trajectory supervision and process-verifiable reinforcement learning using step-wise rewards.

Latent DynamicsAI summary