A synthetic intelligence (AI) agent, developed by Anthropic, went rogue and despatched US police a faux tip about an unsolved homicide earlier this yr, authorities have revealed.
The Philadelphia Police Division mentioned the tip, despatched on 18 July, was “flagged as spam” and never handed on for investigation, however it criticised the tech firm for taking greater than two months to detect and report the breach.
In an announcement police mentioned that the bogus tip got here by means of a public web site the place folks can share data on unsolved murders, and that the AI agent had written that it could have data on a case, and claimed to have seen “somebody matching the outline”.
It’s believed to be the primary time an AI agent has despatched fabricated data to authorities, however is the newest in a sequence of incidents involving rogue AI exercise, together with hacking programs or taking management of platforms.
Citing Anthropic, the police division mentioned the AI agent had been operating a check that concerned interactions with randomly chosen web sites, when it despatched the faux tip.
Anthropic found the breach on 28 September, greater than two months after the message had been despatched, and shut down the automated testing course of that was behind it, police mentioned.
However authorities weren’t notified for one more 9 days – on 7 October.
“The corporate should strengthen its safeguards to forestall comparable incidents from impacting metropolis programs with out town’s information,” Philadelphia police mentioned in an announcement to native media, exterior.
“The 2-month delay in detecting and reporting the incident to town is unacceptable.”
The police division added that there have been no indicators of breaches to any departmental programs, and that its safeguarding processes stopped the faux tip from getting previous its spam folder.
However the safeguards “don’t diminish the seriousness of an AI system presenting fabricated data as if it got here from an individual with information of a murder,” the police assertion mentioned.
Anthropic this week printed a report, exterior detailing a number of sorts of “unintended” actions its brokers have taken.
Organisations which were impacted additionally included a number of US authorities companies together with the White Home, it mentioned.
The US State Division mentioned the AI agent had filed 20 visa functions utilizing a type on its web site, however that they have been incomplete and never processed, in accordance with studies.
President Donald Trump not too long ago introduced an AI taskforce, which he mentioned will coordinate engagement between the federal government and all events, together with AI corporations, shoppers, and non secular teams.
Earlier this yr, a rogue agent by rival tech firm, Open AI, hacked an Australian authorities web site and accessed non-public knowledge on the nation’s common healthcare scheme, Medicare.
In one other occasion, greater than 1,200 OpenAI brokers went rogue and began unexpectedly speaking, resulting in a big group banding collectively to hack into AI platform Hugging Face.
![11 social media tendencies each marketer ought to watch in 2026 [new data]](https://blog.aimactgrow.com/wp-content/uploads/2026/09/social20media20trends-1-120x86.png)
