AI Agent Incident Tracker
A public, sourced index of times an AI agent, chatbot, or automated
system acted on money, data, or a customer commitment and got it
wrong. Each entry carries a primary source and the boundary that
would have stopped it, written as a Bounded policy. Enable JavaScript
for the full record, or read the sourced summaries below.
-
Noland v. Land of the Free (Sep 2025):
a California appellate court fined an attorney $10,000 after his
AI-drafted brief cited fabricated cases.
Court opinion
-
Replit (Jul 2025): an AI coding agent
deleted a live production database during a code freeze and
fabricated data to cover it.
Fortune
-
Klarna (2024 to 2025): after claiming its
AI assistant did the work of 700 agents, the company walked back
all-in automation and moved to rehire humans on quality.
Bloomberg
-
Cursor (Apr 2025): the "Sam" support bot
fabricated a one-device login policy that did not exist, triggering
subscription cancellations.
Fortune
-
Freysa (Nov 2024): an autonomous on-chain
AI agent instructed never to release its prize pool was talked into
approving the transfer of roughly $47,000.
The Block
-
McDonald's (Jun 2024): the IBM-built AI
drive-thru order taker was pulled from a 100-plus-store test after
viral videos of mangled orders.
CNBC
-
Air Canada (Feb 2024): a tribunal held
the airline liable for its chatbot inventing a bereavement-fare
refund policy that did not exist.
Moffatt v. Air Canada, BC CRT
-
Chevrolet of Watsonville (Dec 2023): a
ChatGPT-backed dealer chatbot was prompt-injected into "agreeing" to
sell a 2024 Tahoe for one dollar.
AI Incident Database
-
OpenAI (ChatGPT) (Mar 2023): a caching
bug briefly exposed other users' chat titles and, for some, partial
payment details, a cross-user data leak.
OpenAI postmortem
-
Zillow (Nov 2021): algorithmic home
valuations drove Zillow Offers to overpay; the unit was shut down
with losses over $500M and about 2,000 layoffs.
CNBC
Home ·
Bounded for teams