SyncAI.news, a Varaisys broadcasting
Language-Oriented Semantic Modeling for Target Language Extraction
MS

Mehmet Sinan Y{\i}ld{\i}r{\i}m, Ke Zhang, Shuai Wang, Haizhou Li

· 1 min read

ResearcharXiv cs.CL

Language-Oriented Semantic Modeling for Target Language Extraction

arXiv:2611.26317v1 Announce Type: new Abstract: Target Language Extraction (TLE) aims to isolate speech in a target language from multilingual mixtures. Existing approaches primarily rely on acoustic modeling with language identity labels, which provide only coarse categorical guidance. In this work, we propose a language-oriented semantic modeling framework that augments acoustic extraction with language-specific semantic representations. A pre-trained speech semantic model is adapted via language-aware prompt conditioning and parameter-efficient fine-tuning to generate target-language-focused semantic representations from the mixture. {These capture high-level semantic structure of the acoustics and they} are integrated into the extraction model to provide structured semantic guidance beyond identity labels. Experiments on the CommonVoiceMix dataset show that incorporating semantic representations consistently improves over acoustic-only baselines, achieving up to 1.16 dB SI-SDR gain.

Original source

This story was published by arXiv cs.CL and written by Mehmet Sinan Y{\i}ld{\i}r{\i}m, Ke Zhang, Shuai Wang, Haizhou Li. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News