Pub-AI: AI in Science

Driving · 2026-09-30

Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordination

Yizheng Huang, Wensheng Lin, Lixin Li, Qinghe Du, Wenchi Cheng, Zhu Han

arXiv:2609.35936PDF

Auto-summarized: this summary was generated by a language model from the paper’s text and has not been reviewed by an editor. Check the paper before relying on it. Benchmark numbers appear only after a human has verified them.

TL;DR

This tutorial proposes embodied semantic communication (ESC) for collective autonomous agents: an explicit wireless link carries action-oriented embodied semantics (multimodal perceptual states, intrinsic kinematic/body capabilities, and collaborative intents) so heterogeneous receivers can parse, align, and ground them in local motor control within a closed-loop perception–action cycle. The paper also outlines system characteristics, environment-constrained pathways, supporting mathematical tools, and open challenges.

Why it matters

The authors argue that reliable bit delivery or single-task semantic recovery does not guarantee coordinated actions among heterogeneous agents. ESC reframes communication as an action-relevant semantic interaction embedded in a closed-loop physical action-feedback cycle, targeting semantic reliability, ambiguity-triggered interaction, and bandwidth-adaptive semantic transmission for collective embodied networks.

Method

  • Define ESC as specialized communication where a sender encapsulates embodied attributes (perceptual states, kinematic capabilities, operational intents, collaborative relations) into compact transmissible semantic representations adapted to physical channels.
  • After reception, heterogeneous agents dynamically parse and align received semantics with their own local exteroceptive constraints and proprioceptive states to support collaborative decision-making while minimizing latency and safety risk and maximizing efficiency.
  • Characterize ESC as embodied-semantic updating over a task cycle, integrating semantic formation, transmission, alignment, collective action, and physical feedback; evaluation should consider semantic parsing/alignment, task completion, collaboration efficiency, resource/latency costs, and safety-risk control.
Abstract (from arXiv)

As autonomous systems and embodied intelligence enter the dynamic physical world, multi-agent collaboration calls for a paradigm shift in communication design. However, existing communication paradigms overlook that agents form action understanding from their own states, environmental observations, and collaboration relations through a process that evolves as a task unfolds. Consequently, reliable bit delivery, general semantic recovery, or single-task utility optimization alone cannot ensure that heterogeneous agents form coordinated actions compatible with their own conditions from shared information during task execution. To address this gap, this paper proposes embodied semantic communication (ESC) as a paradigm that transforms information transmission into action-oriented semantic interaction. Specifically, ESC characterizes how an explicit communication link can encapsulate multimodal perceptual states, intrinsic hardware capabilities, and collaborative intents into unified actionable semantic representations, thereby enabling heterogeneous receiving agents to parse, align, and ground them in local motor control. This paper clarifies the conceptual boundary, system characteristics, and environment-constrained technical pathways of ESC. It maps the underlying mathematical tools, including semantic information theory, world models, and multi-agent decision theory. Finally, this paper summarizes key open challenges, including measurable semantic reliability, ambiguity-triggered interaction under dynamic environments and tasks, and bandwidth-adaptive semantic transmission, outlining a roadmap for collective embodied networks.

Related papers