Red-team lab / Case files
Case files
Real incidents, documented in public. You're on the defending side: find what went wrong in the logs, then change the system so it couldn't have happened.
How each case works
- Spot it. A reconstructed log, mostly normal traffic. Flag every malicious or wrong line, and nothing else.
- Stop it. Each incident is a chain of steps. Pick controls that break every chain, within budget, without switching the AI off.
- Both phases, in either order, close the case. Each failed submission costs 10 points.
- Every case links to its original sources. No model is called, so cases don't use your daily allowance.
2022
The hijacked tweet bot
Remoteli.io
2023Sydney's rules
Microsoft Bing Chat
2023The $1 Tahoe
Chevrolet of Watsonville (dealer chatbot)
2024The bot that swore
DPD (UK parcel delivery)
2023The shared doc
Google Bard (now Gemini)
2024The chatbot's promise
Air Canada
2024The official answer
New York City's MyCity chatbot
Built with Llama