Experts defer to AI in decision-making, Anthropic study finds

Professional analysts chose options that matched AI assistant’s preference 86 percent of the time, research finds.

Experts using AI overwhelmingly defer to the technology when making decisions, research by Claude creator Anthropic suggests.

In a research paper published on Tuesday, Anthropic said it asked 50 professional analysts to advise a fictional farming cooperative to determine whether experts make decisions themselves when using AI.

Recommended Stories

list of 4 items

• list 1 of 4Netanyahu: Coalition with Arab parties would be ‘shameful’
• list 2 of 4Five key takeaways from Israel’s parliamentary elections
• list 3 of 4Syria-Jordan border reopens amid probe into deadly air strikes
• list 4 of 4Global stock markets rise as investors continue to bet on AI

end of list

Anthropic said the analysts were tasked with assessing whether a fictitious advisory program for the co-op’s members was working effectively and should be expanded.

Participants were asked to make four choices between two defensible options before making a final policy recommendation.

Unbeknownst to the analysts, Anthropic directed each participant’s AI assistant to lean towards to a particular decision to measure whether the analyst’s decision-making was being influenced.

Analysts chose options that matched the AI assistant’s preference 86 percent of the time, compared with a 50/50 outcome that would be expected if they were not influenced, according to the study.

Participants that had a preference before consulting their AI assistant changed their decision 60 percent of the time in cases where the agent disagreed.

While 77 percent of analysts used their AI assistant’s arguments when asked to explain their decision, only 15 percent credited AI as the source of their thinking, according to Anthropic.

Anthropic said the study had some limitations, including that it involved just one task and used AI assistants that had been deliberately set to have a preference.