← All incidents
07Model DriftIndustry-wide

The agent changed when nobody changed it.

2024–2025

The incident

LLM providers update their models continuously. These updates change how models reason, what they refuse, how they use tools, and what outputs they produce. An agent built and validated against one model version may behave differently after a provider update — with no change made by the deploying organisation, no notification, and no version control.

An AI agent is not a fixed system. Its behaviour is partially determined by external systems that change on a schedule nobody controls.

How Sunbeam helps

CIM behavioural baseline monitoring detects drift from established patterns. New domain access, unusual tool usage, and spend velocity changes trigger alerts automatically.

Source: Gartner, 2025.

Relevant regulations
EU AI Act Article 9
NIST AI RMF MS-2.5
ISO 42001
Related use case
See how Sunbeam controls this →

Could this happen in your organisation?

Find every AI agent operating across your estate in under 10 minutes.

Talk to us