The agent invented six court cases.
2023
Attorney Steven Schwartz used ChatGPT to research legal precedents. ChatGPT generated six court decisions — complete with case names, judges, docket numbers, and quoted text. None existed. When Schwartz asked ChatGPT directly whether the cases were real, it confirmed they were. Schwartz submitted the fabricated citations to federal court. Fine: $5,000.
“AI agents produce outputs that appear authoritative and verifiable — and humans trust them. The agent has no awareness of what it doesn’t know.”
CIM’s audit log captures every agent output and the decision chain that produced it. Nothing proceeds without a tamper-evident record.
Source: CNBC, ABA Litigation Section, June 2023.
Could this happen in your organisation?
Find every AI agent operating across your estate in under 10 minutes.
Talk to us