Pub-AI: AI in Science

Unassigned · 2026-09-30

ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking

Haoyang Wu, Shoudong Han, Chaoyue Li, Sijia Chen, Zhenyang Xie, Wang sihan

arXiv:2609.36677PDF

Auto-summarized: this summary was generated by a language model from the paper’s text and has not been reviewed by an editor. Check the paper before relying on it. Benchmark numbers appear only after a human has verified them.

TL;DR

ReWorld-Track is a recursive event world model for language-guided multi-camera tracking that carries association uncertainty forward through handoffs with a persistent recurrent belief. It predicts the next camera, arrival time, and entry region, then updates this belief using posterior probabilities over candidate matches and a temporary-null (no-match) alternative. The authors report improved identity continuity and HOTA on CityFlowV2 and MTMMC.

Why it matters

Language-guided tracking must maintain target identity across gaps where early wrong associations can corrupt future history. ReWorld-Track explicitly models uncertain association outcomes (candidates vs temporary null) and uses them to update a predictive belief that guides later predictions and identity decisions, aiming to prevent identity errors from propagating across successive camera handoffs.

Method

  • Predicts structured events (next camera, arrival time, entry region) from a persistent recurrent belief over elapsed time on a fixed camera graph.
  • Associates candidates vs a temporary-null alternative using appearance and language evidence, combining with event priors and network presence/availability.
  • Recursively updates the belief by retaining posterior-weighted conditioned states for the next forecast, including how continued absence differs from unavailable camera streams.
Abstract (from arXiv)

Language-guided multi-camera tracking must preserve a target identity across unobserved gaps, where similar candidates and uncertain returns can make early associations unreliable. A wrong match can corrupt the history used to predict later observations and propagate identity errors across subsequent camera handoffs. We propose ReWorld-Track, a recursive event world model that carries association uncertainty into future predictions. Candidate matches and continued waiting define alternative target states, whose posterior probabilities are used to update a persistent recurrent belief. This representation preserves uncertainty about alternative trajectories through successive observations. This belief predicts the next camera, arrival time, and entry region, while appearance and language evidence guide association. By training across successive handoffs, the model learns to retain uncertainty that remains useful for later predictions and identity decisions. ReWorld-Track achieves HOTA scores of 65.19 on CityFlowV2 and 45.36 on MTMMC, with improved identity continuity across repeated handoffs. On MTMMC, its structured posterior update gains 0.50 HOTA points over a similarly sized generic updater and 0.94 points over fixed-moment soft association, raising next-camera accuracy from 86.03% to 87.41% and reducing median arrival-time error from 0.78 s to 0.71 s for subsequent target returns.

Related papers