Anthropic bans ‘abusive or cruel behavior’ toward Claude

What happened

Last August, the company announced it would allow Claude to end conversations with "persistently harmful or abusive" users as part of its research into "model welfare." Anthropic is making changes to its usage policy for the first time in over a year to reflect new and high-risk cases of misuse - including election interference, weapons development, surveillance, and health and financial uses. But one of the most significant changes prohibits "sustained and needless abusive or cruel behavior" toward Claude. Anthropic is an artificial intelligence company based in San Francisco, founded in 2021, and its products and services include Claude and Claude Code.

Key facts

• Last August, the company — announced: it would allow Claude to end conversations with "persistently harmful or abusive" users as part of its research into "model welfare."