SyncAI.news, a Varaisys broadcasting
Context-Aware Multimodal Claim Verification in Spoken Dialogues
CC

Chaewan Chun, Delvin Ce Zhang, Dongwon Lee

· 1 min read

ResearcharXiv cs.CL

Context-Aware Multimodal Claim Verification in Spoken Dialogues

arXiv:2606.11420v2 Announce Type: replace Abstract: Spoken factual claims often occur within multi-turn conversations, where surrounding dialogue can provide context unavailable from the claim alone. Yet most fact-checking research evaluates isolated text, leaving conversational audio under-studied. We introduce MAD2, a synthetic Multi-turn Audio Dialogues benchmark for spoken claim verification with 1,000 two-speaker dialogues, 1,230 sentence-level check-worthy candidate annotations, and approximately 10 hours of audio. We also propose calibrated multimodal fusion of a context-aware audio encoder and a dialogue-aware text model. Adding dialogue context improves verification across settings, although the gains vary by scenario. Past-only context often approaches local offline performance, suggesting its usefulness when future context is unavailable. Fusion achieves its highest mean advantage over text with full-dialogue context, but does not consistently or significantly outperform text across settings. Under full-dialogue context, exploratory subgroup results show greater performance variation across dialogue scenarios for text and fusion, but across spread styles for audio.

Original source

This story was published by arXiv cs.CL and written by Chaewan Chun, Delvin Ce Zhang, Dongwon Lee. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News