Skip to search boxSkip to navigationSkip to main content

Failing Our Youngest: On the Biases, Pitfalls, and Risks in a Decision Support Algorithm Used for Child Protection

Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-review

Open access

Publication Information

Output type

Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 290-300

Publication milestones

  • Published - 2024

Publication status

Published - 2024

Publication IDs

  • Scopus: 85196637869

Host publication title

FAccT '24: Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency

Abstract

In recent years, Danish child protective services have experienced increasing pressure, prompting the adoption of a decision-support algorithm to aid caseworkers in identifying children at heightened risk of maltreatment, named Decision Support. Despite its critical role, this algorithm has not undergone formal evaluation. Through a freedom of information request, we were able to partially access the algorithm and conduct an audit. We find that the algorithm has significant methodological flaws, suffers from information leakage,
relies on inappropriate proxy values for maltreatment assessment, generates inconsistent risk scores, and exhibits age-based discrimination. Given these serious issues, we strongly advise against the use of this kind of algorithms in local government, municipal, and child protection settings, and we call for rigorous evaluation of such tools before implementation and for continual monitoring post-deployment by listing a series of specific recommendations.

Publication metrics

PlumX

Citations
10
Captures
29

Related Event

Title

Conference on Fairness, Accountability, and Transparency

Event type

Conference

Degree of recognition

International event

Date

03/06/2024 - 06/06/2024

Location

Rio de JaneiroBrazil