SyncAI.news, a Varaisys broadcasting
Benchmarking AI risk behaviors
LM

Luhan Mikaelson, Robert Adragna, Emmett Brosowsky, Hayley Clatterbuck

· 1 min read

ResearcharXiv cs.AI

Benchmarking AI risk behaviors

arXiv:2611.16318v1 Announce Type: new Abstract: We evaluate LLM risk propensities across a range of contexts and task demands. We evaluate models for how risk averse or risk tolerant they are in various conditions, as well as how stable and consistent their behavior is across conditions. We present a toolkit for developing model risk profiles that can be used to predict model behavior and which can be adapted to include new evaluations of risk propensities. We also examine how these properties have changed across model generations and families. We observe that 2026 state-of-the-art models tend to be more stable, more consistent, and more risk neutral than older models. These trends appear to be related; newer models are more stable and consistent because they are more likely to use expected value maximization as a decision procedure.

Original source

This story was published by arXiv cs.AI and written by Luhan Mikaelson, Robert Adragna, Emmett Brosowsky, Hayley Clatterbuck. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News