AI needs ‘crash tests’ for kids? Ex-Google safety chief warns of ‘very severe’ harm to children

Artificial intelligence may need the equivalent of car crash testing before children are allowed to rely on it, according to Tom Siegel, a former Google trust and safety executive who has taken charge of a new research institute focused on the risks AI poses to young users

Artificial intelligence may need the equivalent of car crash testing before children are allowed to rely on it, according to Tom Siegel, a former Google trust and safety executive who has taken charge of a new research institute focused on the risks AI poses to young users.

Siegel has called for a slowdown in AI development, warning that technology companies are repeating mistakes made during the social media era while rolling out increasingly capable AI systems without adequate safeguards for children.

“We find ourselves in a really terrible situation in terms of what AI is doing to kids,” Siegel told Reuters. “The idea that the industry will figure it out by itself without outside help is unrealistic.”

Former Google safety chief joins Youth AI Safety Institute

Siegel announced Tuesday that he had joined Common Sense Media as the first executive director of its Youth AI Safety Institute, launched in May to study children's use of AI and develop safety standards.

He said the institute would work on standards that could hold AI companies accountable, while collaborating with technology firms and independent organisations.

The initiative comes as AI tools become increasingly common among young users. Common Sense Media research has found that 86% of children aged 9 to 17 have used AI, while nearly a quarter said they use it daily.

Siegel previously worked at Google from 2004 to 2019 before co-founding TrustLab, a company that developed tools to identify online safety threats. He stepped down as TrustLab's CEO earlier this month to take up his new role.

AI risks for children include suicide and psychosis

Siegel said the potential risks extend beyond concerns about children becoming overly dependent on AI.