Training Controllable World Models via Action Influence Maximization
Action-conditioned video world models trained on successful demonstrations can ignore commanded actions due to insufficient action influence in the dataset. The authors analyze an explained-action-information metric and introduce Action Influence Maximization (AIM) to actively collect data that increases dataset mutual information about actions and next states. In pixel manipulation (Push-T), AIM is reported as the only method that consistently improves controllability, matching a 300k expert model with only 500 actively collected episodes added to 3k demonstrations.
