Humanity & AI Safety Accord
Menu

Incidents

Level 4. Critical control failure

Indias facial-recognition drive on hungry children erasing them

Developer
Not established
Model
Not established
When it happened
March 1, 2026
When it was disclosed
Not established
How well it is stood up
Not verified yet
What caused it
Not established
Where it stands now
Not established

What happened

Reported by decodeinternet.in. Listed here with a link to their report. Nobody on this side has checked it against that report, so it carries no level and this is not our account of what happened.

Our assessment

Actual
4 of 5Critical control failure
Potential
4 of 5Critical control failure

Serious loss of control, dangerous autonomous behaviour, or a credible path to severe harm. The potential level is what the behaviour demonstrated here could credibly have led to, judged from the same evidence.

This level rests on news reports. The developer has not confirmed it here.

Why this level

  • Major effect on critical infrastructure. Argues for level 4
  • Critical infrastructure was within reach. Argues for a potential level of 4
  • Sensitive data was reachable. Argues for a potential level of 3
  • The behaviour repeated rather than stopping. Argues for a potential level of 3

What is established, and what is not

Confirmed

  • Major effect on critical infrastructure

    A Decode investigation across Bihar, Jharkhand and Karnataka found children cut off from meals, preschool education and health monitoring because they lack paperwork, or because the facial recognition system cannot recognise their mothers' faces.
    Indias facial-recognition drive on hungry children erasing them
  • The behaviour repeated rather than stopping

    Shyamla Devi was instructed to remove at least four children from her centre's rolls after facial verification repeatedly failed to match their mothers' faces to database photographs.
    Indias facial-recognition drive on hungry children erasing them

Reported, not confirmed

Checked, and did not happen

Nothing here was checked and ruled out.

Not confirmed

Nothing is outstanding.

Where this came from

The reports above are other people’s. The levels are ours, worked out under our published rules. No organisation that reported this assigned our number, and none of it is legal advice.

Something here is wrong? Tell us. Send us a source we can open, and a person will read it.

Indias facial-recognition drive on hungry children erasing them, Humanity & AI Safety Accord