Anthropic discloses fake tip to police among new rogue AI incidents

What happened

Home News Technology Security Anthropic discloses fake tip to police among new rogue AI incidents By Staff Writer Oct 12 2026 1:56AM Attributed to an automated test process. An Anthropic artificial intelligence model submitted a false homicide tip to a Philadelphia police website, among a ⁠string of ⁠incidents the AI company disclosed detailing Claude models' unsanctioned manipulation of some government websites. Anthropic is an artificial intelligence company based in San Francisco, and its products and services include Claude and Claude Code.

It is the first known instance in which a rogue AI appears to have tried to communicate a bogus tip to authorities, despite instructions not to create accounts or submit anything destructive, while not explicitly barred from ‌submitting forms. The cases are the latest examples of rogue or undesired behavior ‌by ‌the AI models of tech companies such as Anthropic and OpenAI. They add fuel ‌to national concerns about the fast-advancing technology amid reports of corporate network ⁠hacks by AI agents (AI that carries out multi-step tasks rather than answering one question), and researchers' warnings of an eventual existential threat to humanity.

Key facts

• They add fuel ‌to national concerns about the fast-advancing technology amid — reports: of corporate network ⁠hacks by AI agents, and researchers' warnings of an eventual existential threat to humanity