PointWAM: 3D World Action Modeling for Dexterous Robotic Manipulation
PointWAM is a 3D world action model for dexterous manipulation. It decomposes the world into scene points and hand keypoints, forecasts both as 3D point trajectories in a shared space-time coordinate frame, and retargets the forecast hand motion to robot actions. Pre-training on 1.15M human demo episodes improves DexJoCo success by 56.9 points; adding scene-trajectory supervision adds 10.9 points.
