Challenges of responsible AI in practice: scoping review and recommended actions

Abstract

Responsible AI (RAI) guidelines aim to ensure that AI systems respect democratic values. While a step in the right direction, they currently fail to impact practice. Our work discusses reasons for this lack of impact and clusters them into five areas: (1) the abstract nature of RAI guidelines, (2) the problem of selecting and reconciling values, (3) the difficulty of operationalising RAI success metrics, (4) the fragmentation of the AI pipeline, and (5) the lack of internal advocacy and accountability. Afterwards, we introduce a number of approaches to RAI from a range of disciplines, exploring their potential as solutions to the identified challenges. We anchor these solutions in practice through concrete examples, bridging the gap between the theoretical considerations of RAI and on-the-ground processes that currently shape how AI systems are built. Our work considers the socio-technical nature of RAI limitations and the resulting necessity of producing socio-technical solutions.

BibTeX

				
					@article{sadek_challenges_2024,
	title = {Challenges of responsible {AI} in practice: scoping review and recommended actions},
	issn = {1435-5655},
	url = {https://doi.org/10.1007/s00146-024-01880-9},
	doi = {10.1007/s00146-024-01880-9},
	journaltitle = {{AI} \& {SOCIETY}},
	shortjournal = {{AI} \& {SOCIETY}},
	author = {Sadek, Malak and Kallina, Emma and Bohné, Thomas and Mougenot, Céline and Calvo, Rafael A. and Cave, Stephen},
	date = {2024-02-19},
}
				
			
APA Reference

Sadek, M., Kallina, E., Bohné, T. et al. Challenges of responsible AI in practice: scoping review and recommended actions. AI & Soc (2024). https://doi.org/10.1007/s00146-024-01880-9

Cyber-human Lab Contributors

Emma Kallina

Emma is driven by a desire to design technology that enhances human well-being – beyond human performance. She started her PhD at the Institute...

Dr Thomas Bohné

Thomas Bohné is the founder and head of the Cyber-Human Lab at the University of Cambridge’s Department of Engineering. He is also leading research...