Mapping the Tool Landscape for Stakeholder Involvement in Participatory AI: Strengths, Gaps, and Future Directions

Abstract

Stakeholder Involvement (SHI) during technology development is increasingly promoted in responsible AI (rAI) guidance. However, the lack of concrete, actionable tools to realise this is a well-known issue. To inform the future development of such SHI-supporting tools, this study presents an analysis of the existing tool landscape. We reviewed 216 rAI tools (covering seven meta-reviews, 2020-2024), revealing that only 18% provide actionable support for SHI. Mapping these tools to both the SHI process and the AI lifecycle, we found a strong focus on support when communicating with stakeholders, especially during early ideation stages. Tools supporting many other practical aspects of SHI were rare (e.g. recruiting stakeholders or storing insights) as were tools supporting reactions to gained insights and tools for participation during the testing stage. We point practitioners towards existing tool support and recommend concrete actions and immediate research agendas to address the exposed gaps, facilitating rAI-aligned SHI going forward.

BibTeX

				
					@inproceedings{10.1145/3706599.3719726,
author = {Kallina, Emma and Singh, Jatinder},
title = {Mapping the Tool Landscape for Stakeholder Involvement in Participatory AI: Strengths, Gaps, and Future Directions},
year = {2025},
isbn = {9798400713958},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3706599.3719726},
doi = {10.1145/3706599.3719726},
abstract = {Stakeholder Involvement (SHI) during technology development is increasingly promoted in responsible AI (rAI) guidance. However, the lack of concrete, actionable tools to realise this is a well-known issue. To inform the future development of such SHI-supporting tools, this study presents an analysis of the existing tool landscape. We reviewed 216 rAI tools (covering seven meta-reviews, 2020-2024), revealing that only 18\% provide actionable support for SHI. Mapping these tools to both the SHI process and the AI lifecycle, we found a strong focus on support when communicating with stakeholders, especially during early ideation stages. Tools supporting many other practical aspects of SHI were rare (e.g. recruiting stakeholders or storing insights) as were tools supporting reactions to gained insights and tools for participation during the testing stage. We point practitioners towards existing tool support and recommend concrete actions and immediate research agendas to address the exposed gaps, facilitating rAI-aligned SHI going forward.},
booktitle = {Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems},
articleno = {389},
numpages = {8},
keywords = {Participatory AI Development, Stakeholder Involvement, Responsible AI, Practitioner Tools},
location = {
},
series = {CHI EA '25}
}
				
			
APA Reference
Kallina, E., & Singh, J. (2025). Mapping the Tool Landscape for Stakeholder Involvement in Participatory AI: Strengths, Gaps, and Future Directions. In Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery.

Cyber-human Lab Contributors

Emma Kallina

Emma is driven by a desire to design technology that enhances human well-being – beyond human performance. She started her PhD at the Institute...