SyncAI.news, a Varaisys broadcasting
Spoken Function Calling: A New Perspective on Spoken Language Understanding for Large Audio Language Models
YP

Yuezhang Peng, Yuxin Liu, Changfeng Gao, Zhifu Gao, Qian Chen, Xiangang Li, Xie Chen

· 1 min read

ResearcharXiv cs.CL

Spoken Function Calling: A New Perspective on Spoken Language Understanding for Large Audio Language Models

arXiv:2608.05126v2 Announce Type: replace Abstract: Spoken Language Understanding (SLU) is the core component of task-oriented dialogue systems and a pivotal link in achieving seamless human-agent interaction. While traditional SLU can effectively extract user semantics for closed-set tasks after in-domain supervised fine-tuning, it faces significant challenges in leveraging in-context learning for open-domain tasks due to its ambiguous rule definitions. This work proposes Spoken Function Calling (SFC), a novel semantic understanding perspective that optimizes semantic understanding with structured rule definitions, to evolve beyond traditional closed-set SLU. Specifically, we curate and extend a suite of spoken functions based on traditional SLU datasets, construct a multi-agent system to synthesize the SFC-Bench dataset, evaluate the performance of Large Language Models (LLMs) and Large Audio Language Models (LALMs), and enhance the SFC capabilities of LALMs through post-training. Experiments demonstrate that SFC outperforms traditional SLU, substantially enhancing the semantic extraction accuracy for LLMs and LALMs.

Original source

This story was published by arXiv cs.CL and written by Yuezhang Peng, Yuxin Liu, Changfeng Gao, Zhifu Gao, Qian Chen, Xiangang Li, Xie Chen. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News