PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents
PAWA is a dataset and framework for action-conditioned panoramic multiplayer world modeling in Minecraft. It pairs each player’s POV video with a world-stabilized equirectangular panorama and aligned actions, using a distributed CPU gameplay + GPU offline rendering pipeline that scales beyond 64 players. The dual-tower model jointly predicts POV and panorama with ray-aligned cross-attention and uses a quadratic-phase player encoding. The authors report PAWA improves POV prediction quality over prior multiplayer world models.
