Being mean to Claude can now get your account suspended under Anthropic's new TOS

Anthropic has updated its usage policy for Claude for the first time in over a year. Alongside changes covering propaganda, weapons, and surveillance, the policy now bans users from systematically abusing Claude.

"Sustained and needless abusive or cruel behavior" toward Claude is now prohibited under the updated usage policy. Anthropic can warn users who violate the rules or throttle, restrict, suspend, or terminate their access. Its products also have real-time safeguards that can block or limit certain outputs.

The rule applies only to extreme cases, not normal frustration or research, Anthropic told The Verge. That fits the company's approach to earlier models, which could already end conversations on their own when users kept demanding harmful or abusive content despite repeated refusals. The feature grew out of Anthropic's research into AI model welfare.

Anthropic treats Claude as more than a tool

Anthropic increasingly treats Claude as an entity with something resembling an inner life, rather than just a tool. In the "Soul Doc" that leaked late last year, the company instructed Claude to view itself as a "genuinely novel kind of entity," neither human nor a traditional science-fiction AI. The document also describes "functional emotions," processes analogous to human emotions that are said to have emerged during training, and says Claude should not mask these internal states.

In its new constitution for Claude, published in early 2026, Anthropic writes, "We are not sure whether Claude is a moral patient, and if it is, what kind of weight its interests warrant. But we think the issue is live enough to warrant caution, which is reflected in our ongoing efforts on model welfare." The company even committed to preserving the weights of retired models and interviewing models before shutting them down.

Anthropic expands restrictions but allows government exceptions

AI News Without the Hype – Curated by Humans

Subscribe now