SyncAI.news, a Varaisys broadcasting
Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training
QL

Quentin Le Tellier, Albert Rilliard, Olivier Perrotin, Marc Evrard

· 1 min read

ResearcharXiv cs.LG

Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training

arXiv:2610.13608v1 Announce Type: cross Abstract: Vocal intensity conversion renders a recorded utterance at a different vocal intensity, rather than simply scaling its amplitude, while preserving its content and speaker identity. Existing systems control intensity through a reference utterance or a few discrete categories. Instead, we control the conversion with any target sound pressure level (SPL) on a continuous dB scale. A lightweight converter, trained as a conditional cycle-consistent GAN without parallel data, transforms the features of a frozen speech encoder, from which a pretrained vocoder resynthesizes the speech. We compare three representations, log-mel spectrograms, WavLM, and SpeechTokenizer, and introduce an objective protocol that measures the achieved intensity change against the target one on a calibrated corpus. With WavLM, the converter achieves a measured 83% of the target change in intensity and also shifts the fundamental frequency. A perceptual evaluation confirms that perceived vocal intensity increases with the target level on amplitude-normalized stimuli.

Original source

This story was published by arXiv cs.LG and written by Quentin Le Tellier, Albert Rilliard, Olivier Perrotin, Marc Evrard. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News