Named source: UK National Audit Office · independent report, October 2025
The case, explained simply
DWP · when missing data limits fairness assurance
An independent audit shows why performance evidence and fairness evidence must be examined separately.

- Risk signal
- Measure consequences
- Check group-level evidence
- Correct, challenge and review
Explanatory workflow. Read the linked case or sector analysis for the evidence, conditions and limits behind each step.
What actually happened
The UK National Audit Office’s October 2025 report examined benefit fraud-and-error controls, including machine learning. It reported that limited data allowed DWP fairness analysis on only one of nine protected characteristics. This identifies an assurance gap; it does not prove that every unmeasured group was treated unfairly.
Why this matters for adoption
For a Greek public body, bank, insurer or employer, a good average result cannot answer who bears the errors. A risk flag may create investigation, delay and stress even when a human makes the final decision. Governance therefore needs evidence on affected groups, the practical consequences of flags and a way for people to challenge an error.
THE CASE AT A GLANCE
Read a case like a decision-maker.
Do not stop at the headline. Follow the four things that make a case useful in a different organisation.
Which task actually changed?
What was measured, by whom and in what setting?
What must your team test before it relies on this?
THE LESSON BEHIND THE CASE
What has to be true for this to help?
An unknown fairness effect must stay unknown in the decision record. Missing data is not proof of equal treatment, and it is not proof of discrimination either. A responsible service describes the gap and limits reliance while it gathers appropriate evidence. Follow a risk flag through the whole process: investigation, delay, staff judgement and correction. A human reviewer only helps when they can see the evidence and genuinely disagree. Assess whether error burdens fall differently across relevant groups rather than assuming a good average protects everyone.
A Greek organisation assessing a fraud-risk workflow could review how a mistaken flag affects an ordinary case. Document review delay, evidence demands and access to correction. If relevant group-level evidence is unavailable, record the limitation and restrict the proposed system’s authority.
A PRACTICAL EVALUATION PLAN
What to check, and what it will tell you
Error consequence
Trace delay, investigation and correction after a false flag.
A flag can burden someone before a final decision.
Evidence coverage
Mark which relevant groups can and cannot be assessed.
Missing coverage must not become a pass.
Effective challenge
Test reviewer authority and the person’s correction route.
Human oversight must be operationally meaningful.
Proposed evaluation for your team. These are not additional reported results from the featured organisation.
An independent audit identifies an assurance gap at a particular time; it does not prove every unmeasured group suffered discrimination.
A PRACTICAL DECISION MAP
What your team needs to make this work
Have this ready
Consequence mapping and lawful, appropriate fairness evidence
Look for this result
Error burdens, correction and evidence gaps by affected group
Pause if you see this
Unmeasured groups are treated as proven equally protected
An editorial guide for planning your own trial. Agree the required result and acceptable effort with the people who do the work.
What the evidence does not tell us
The audit is a time-specific assessment of one administration’s controls. It should not be read as a finding about all public AI or a current determination about every later model version. Its important lesson is that an unmeasured effect must remain visible as unknown.
What a Greek organisation can learn
- Measure the consequence of a wrong flag.
- Keep missing fairness evidence visible.
- Make human review and correction practical.
How to test the idea in your organisation
Map what happens to a person after a flag. Record false alarms, missed problems, review time and correction access, then assess differences using lawful and appropriate data. If important groups cannot be assessed, state the gap and limit the system’s authority while the evidence is improved.
Before spending money
A human in the process is a meaningful safeguard only when they have the time, information and authority to disagree.
Read the original evidence
UK National Audit Office · independent report, October 2025 ↗The practical steps above are AIStrategy’s editorial suggestions. They are not reported actions or promised results from the organisation featured. Photography illustrates the subject unless its caption identifies the actual facility.