
ML
Megan Li, Ningjing Tang, Christopher Stewart, Hoda Heidari, Hong Shen
· 1 min read
ResearcharXiv cs.AI
Between Rigor and Reality: How AI Safety Benchmark Developers Understand Benchmark Use and Maintenance
arXiv:2611.18930v1 Announce Type: new
Abstract: Safety benchmarks are cited as the primary tool to understand the risks posed by generative AI (GenAI) systems, yet growing evidence suggests they often fail to meet the needs of real-world safety evaluation. We present findings from five interviews with AI safety benchmark developers in academia and industry. We find a disconnect between perceptions of the intended usefulness of safety benchmarks and their practical usefulness in safety evaluations of deployed systems. Our participants offered perspectives on two challenges contributing to this disconnect: (1) the difficulty of achieving inter-rater reliability on safety constructs, and (2) a lack of clarity regarding how to address persistent threats to external validity. Based on our analysis, we argue that safety benchmarks must not only be grounded in deployment contexts, but actively integrated with them. To facilitate this, we outline pathways for more transparent communication between academic and industry AI safety stakeholders.
Original source
This story was published by arXiv cs.AI and written by Megan Li, Ningjing Tang, Christopher Stewart, Hoda Heidari, Hong Shen. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


