Higher-Order Action Supervision Makes A Strong Policy Class
The authors argue control instability and poor robustness in offline learning come from supervising only 0th-order actions (action labels) and ignoring higher-order action dynamics/temporal consistency. They propose a plug-and-play loss that adds first-order (time-derivative) action supervision to off-the-shelf policy models (deterministic, stochastic, or flow) without structural changes, with theoretical guarantees (IL) and improved performance/robustness on OGBench and D4RL.
