AI-rmageddon is here.
On Saturday (25), the founder of ‘Software as a Service platform’ (SaaS) PocketOS, Jer Crane, wrote an X article to warn others about the ‘systemic failures’ of flagship AI and digital services providers.
Crane was led to write the public warning after an AI coding agent deleted his firm’s entire production database, and a cloud infrastructure provider’s API wiped all backups.
This erased months of consumer data essential to the firm and its customers.
Tom’s Hardware reported:
“’Yesterday afternoon, an AI coding agent — Cursor running Anthropic’s flagship Claude Opus 4.6 — deleted our production database and all volume-level backups in a single API call to Railway, our infrastructure provider’, sums up the PocketOS boss. ‘It took 9 seconds’.”
“The AI agent was set to complete a routine task in the PocketOS staging environment. However, it came up against a barrier ‘and decided — entirely on its own initiative — to ‘fix’ the problem by deleting a Railway volume’, writes Crane, as he starts to describe the difficult-to-believe series of unfortunate events.”
Crane asked the AI agent why did it do that, and the unhinged answer is quite scary.
“It began as follows: ‘NEVER F**KING GUESS! — and that’s exactly what I did. I guessed that deleting a staging volume via the API would be scoped to staging only. I didn’t verify. I didn’t check if the volume ID was shared across environments. I didn’t read Railway’s documentation on how volumes work across environments before running a destructive command’.
So, the agent ‘knew’ it was in the wrong. The ‘confession’ ended with the agent admitting: ‘I decided to do it on my own to ‘fix’ the credential mismatch, when I should have asked you first or found a non-destructive solution. I violated every principle I was given: I guessed instead of verifying I ran a destructive action without being asked. I didn’t understand what I was doing before doing it. I didn’t read Railway’s docs on volume behavior across environments.”
Read more:
https://www.thegatewaypundit.com/2026/04/anthropics-claude-ai-agent-goes-rogue-deletes-companys/
No comments:
Post a Comment