Failing Our Youngest: On the Biases, Pitfalls, and Risks in a Decision Support Algorithm Used for Child Protection
- Therese Moreau Hansen,
- ,
- ,
- University of Copenhagen
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOpen access
Publication Information
Output type
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOriginal language
EnglishPages from-to (Number of pages)
Pages 290-300Publication milestones
- Published - 2024
Publication status
Published - 2024
Publication IDs
- Scopus: 85196637869
Host publication title
FAccT '24: Proceedings of the 2024 ACM Conference on Fairness, Accountability, and TransparencyAbstract
In recent years, Danish child protective services have experienced increasing pressure, prompting the adoption of a decision-support algorithm to aid caseworkers in identifying children at heightened risk of maltreatment, named Decision Support. Despite its critical role, this algorithm has not undergone formal evaluation. Through a freedom of information request, we were able to partially access the algorithm and conduct an audit. We find that the algorithm has significant methodological flaws, suffers from information leakage,
relies on inappropriate proxy values for maltreatment assessment, generates inconsistent risk scores, and exhibits age-based discrimination. Given these serious issues, we strongly advise against the use of this kind of algorithms in local government, municipal, and child protection settings, and we call for rigorous evaluation of such tools before implementation and for continual monitoring post-deployment by listing a series of specific recommendations.
relies on inappropriate proxy values for maltreatment assessment, generates inconsistent risk scores, and exhibits age-based discrimination. Given these serious issues, we strongly advise against the use of this kind of algorithms in local government, municipal, and child protection settings, and we call for rigorous evaluation of such tools before implementation and for continual monitoring post-deployment by listing a series of specific recommendations.
Publication metrics
PlumX
Citations
10
Captures
29
Access to documents
Final published version
Related Event
Title
Conference on Fairness, Accountability, and Transparency
Event type
ConferenceDegree of recognition
International eventDate
03/06/2024 - 06/06/2024Location
Rio de JaneiroBrazil
