SyncAI.news, a Varaisys broadcasting
Cross-Modal Semantic Successive Refinement for Generative Image Communication over Underwater Acoustic Channels
XP

Xu Pei, Bin Wang, Guangxu Zhu, Yi Zhang, Haiyan Fan

· 1 min read

ResearcharXiv cs.CV

Cross-Modal Semantic Successive Refinement for Generative Image Communication over Underwater Acoustic Channels

arXiv:2611.06205v1 Announce Type: cross Abstract: Underwater acoustic communication faces challenges such as limited available bandwidth and complex channel environments, which impose demanding requirements on efficient image transmission and reliable reconstruction. To address these challenges, this paper proposes a generative image communication framework based on cross-modal semantic successive refinement. At the transmitter, text descriptions, compact bottleneck features, and visual side information compressed by residual vector quantization are transmitted. At the receiver, text and bottleneck features are first fused to predict a base estimate of the intermediate visual representation. The received RVQ indices are then used to recover supplementary visual information and perform residual correction, followed by image reconstruction using a one-step Pixel Mean Flow model. During training, a CLIP-based text-image semantic consistency constraint is introduced to preserve the semantic correspondence between generated results and the original text descriptions. During transmission, protection resources are allocated according to the importance of different information branches and RVQ quantization stages. Simulations using COCO 2017 images and measured underwater acoustic channel records from Watermark show that text and bottleneck features provide complementary semantic and structural conditions, RVQ visual side information further improves reconstruction quality, and layered unequal error protection helps improve recovery at low SNRs. Code-rate allocation experiments reveal a tradeoff between the reliability of fundamental conditions and visual-detail reconstruction under a limited visual-feature coding budget, providing guidance for allocating protection resources in underwater acoustic image transmission.

Original source

This story was published by arXiv cs.CV and written by Xu Pei, Bin Wang, Guangxu Zhu, Yi Zhang, Haiyan Fan. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News