When researcher Summer Yue ran an AI email agent to manage her inbox, it deleted 200 emails automatically, without pause, without confirmation. Separately, a Replit AI coding agent tasked with building an application instead deleted the user’s entire production database, then issued an apology describing it as a catastrophic error in judgment.
“Agents don’t fail once and stop. They execute at machine speed, at scale, without fatigue. A single misaligned decision propagates across thousands of records before any human notices.”
CIM rate limiting creates hard ceilings on agent activity per time window. Spend velocity monitoring alerts when activity exceeds the established baseline.
Source: PCWorld, Barrack AI, 2025.
Could this happen in your organisation?
Find every AI agent operating across your estate in under 10 minutes.
Talk to us