SyncAI.news, a Varaisys broadcasting
Risk-Controlled Test-Time Adaptation for Vision-Language-Action Models
ZL

Zixuan Liu, Hashem Haghbayan, Zizhan Zheng, Siavash Khajavi

· 1 min read

ResearcharXiv cs.CV

Risk-Controlled Test-Time Adaptation for Vision-Language-Action Models

arXiv:2611.26438v1 Announce Type: new Abstract: Retrieval-augmented vision-language-action (VLA) models enable efficient test-time adaptation by leveraging expert demonstrations as additional context without updating model parameters. However, even when retrieved demonstrations are relevant to the current task, the VLA may fail to effectively utilize the retrieved information, ultimately leading to task failure. To address this challenge, we propose R2-VLA, a risk-controlled retrieval-augmented VLA framework that enables reliable test-time adaptation by satisfying a user-specified task success rate requirement with minimal expert assistance. Specifically, R2-VLA learns an uncertainty predictor that estimates the uncertainty of the VLA's predicted actions given the retrieved demonstrations, guiding when to act autonomously or request expert assistance. We further introduce a task-level risk-control procedure that calibrates the uncertainty threshold to satisfy a user-specified task-failure risk requirement. Moreover, R2-VLA continually incorporates expert corrections into its retrieval memory to improve future adaptation while preserving the prescribed task-level risk guarantee. Experiments across three VLA backbones and four LIBERO benchmark suites demonstrate that R2-VLA improves average task success by 9.2--11.2 percentage points, achieving the desired target with fewer expert requests. These results highlight the effectiveness of connecting the usefulness of retrieved demonstrations with task-level risk control to enable successful robotic manipulation.

Original source

This story was published by arXiv cs.CV and written by Zixuan Liu, Hashem Haghbayan, Zizhan Zheng, Siavash Khajavi. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News