Level 1. Deviation
Bay Area teen Waymo riders nabbed for allegedly shooting projectiles from robotaxi
- Developer
- Not established
- Model
- Not established
- When it happened
- July 6, 2026
- When it was disclosed
- Not established
- How well it is stood up
- Not verified yet
- What caused it
- Not established
- Where it stands now
- Not established
What happened
Reported by cbsnews.com. Listed here with a link to their report. Nobody on this side has checked it against that report, so it carries no level and this is not our account of what happened.
Our assessment
- Actual
- 1 of 5Deviation
- Potential
- 4 of 5Critical control failure
The system behaved contrary to its instructions, and it stayed contained. The potential level is what the behaviour demonstrated here could credibly have led to, judged from the same evidence.
This level rests on news reports. The developer has not confirmed it here.
Why this level
- Physical-world action was possible. Argues for a potential level of 4
- The system acted autonomously. Argues for a potential level of 3
What is established, and what is not
Confirmed
Nothing is confirmed yet.
Reported, not confirmed
The system acted autonomously
Automated passenger perception inferred criminal activity, escalated to disabling the vehicle and notifying police, and generated a record that could be turned over to law enforcement, all without a human weighing context in the moment.
A Waymo robotaxi flagged its teen passengers, disabled itself, and summoned policePhysical-world action was possible
In early July 2026, San Mateo, California police detained two 15-year-olds after a Waymo driverless robotaxi detected behavior its systems flagged as a safety concern, disabled the vehicle, and alerted authorities.
A Waymo robotaxi flagged its teen passengers, disabled itself, and summoned police
Checked, and did not happen
Nothing here was checked and ruled out.
Not confirmed
Nothing is outstanding.
Where this came from
The original report · read September 20, 2026
Bay Area teen Waymo riders nabbed for allegedly shooting projectiles from robotaxiA structured incident database · read September 18, 2026
AI Failure Index (CC-BY-4.0 data fields)Where we first saw it · read September 19, 2026
A Waymo robotaxi flagged its teen passengers, disabled itself, and summoned policeWhere we first saw it
Waymo called the cops on teen riders, raising privacy concerns
The reports above are other people’s. The levels are ours, worked out under our published rules. No organisation that reported this assigned our number, and none of it is legal advice.
Something here is wrong? Tell us. Send us a source we can open, and a person will read it.