SyncAI.news, a Varaisys broadcasting
Anatomy-aware cross-speaker adaptation of complete vocal-tract acoustic-to-articulatory inversion
NN

Nhat-Nam Nguyen, Pierre-Andre Vuissoz, Yves Laprie

· 1 min read

ResearcharXiv cs.AI

Anatomy-aware cross-speaker adaptation of complete vocal-tract acoustic-to-articulatory inversion

arXiv:2609.29766v1 Announce Type: cross Abstract: Cross-speaker acoustic-to-articulatory inversion requires accounting for anatomical differences between speakers. We propose a geometric adaptation framework that uses anatomical landmarks, primarily on vertebrae and dental structures,to transfer predictions from a fixed inversion model to unseen speakers. An affine transformation followed by thin-plate spline (TPS) deformation maps the predicted contours of 10 vocal-tract structures into each target speaker's geometry without retraining. Landmarks are identified in one selected /u/ frame per speaker as a common phonetic reference without assuming identical articulatory configurations across speakers, and the resulting mapping is reused across recordings. We train the model on a single-speaker rt-MRI database and evaluate adaptation on eight speakers from a separate multi-speaker rt-MRI database. We compare affine and TPS configurations using 12 or 14 landmarks. Affine12+TPS14 achieves the lowest mean point-to-closest-point error of 3.19mm. These results support the combined value of anatomical landmark information and nonrigid alignment.

Original source

This story was published by arXiv cs.AI and written by Nhat-Nam Nguyen, Pierre-Andre Vuissoz, Yves Laprie. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News