Assisting visual search task with augmented reality: an exploratory study in an industrial workshop

Abstract

Engaging in visual search tasks entails the identification of a target object within a typically intricate background. Furthermore, the task’s complexity escalates when tracked objects are obscured or resemble items located nearby. This challenge is particularly pronounced in cluttered industrial environments, where tools of diverse sizes and shapes are often grouped in close proximity. In such settings, the swift and accurate identification of the correct tool plays a pivotal role in facilitating manual tasks like assembly or device repair. To improve visual search capabilities, we propose leveraging augmented reality (AR) head-mounted displays (HMDs) equipped with cutting-edge object detection functionalities. To substantiate this proposal, we conducted an exploratory study featuring eleven participants within a highly ecologically valid experimental environment. The study’s outcomes underscore the transformative potential of AR HMDs in efficiently locating objects within the chaotic backdrop of an industrial setting. The explored approach enhances human capabilities and sheds light on novel experimental designs. Integrating the Segment Anything Model and the {YOLOv}8 object detection model further amplifies the effectiveness of visual search tasks.

BibTeX

				
					@article{lysakowski_assisting_2026,
	title = {Assisting visual search task with augmented reality: an exploratory study in an industrial workshop},
	volume = {85},
	issn = {1573-7721},
	url = {https://doi.org/10.1007/s11042-026-21516-y},
	doi = {10.1007/s11042-026-21516-y},
	pages = {342},
	number = {4},
	journaltitle = {Multimedia Tools and Applications},
	author = {Łysakowski, Mikołaj and Żywanowski, Kamil and Banaszczyk, Adam and Nowicki, Michał R. and Skrzypczyński, Piotr and Bohné, Thomas and Tadeja, Sławomir K.},
	date = {2026-04-10},
}
				
			
APA Reference

M. Łysakowski, K. Żywanowski, A. Banaszczyk, M.R. Nowicki, P. Skrzypczyński, T. Bohné, S.K. Tadeja, Assisting visual search task with augmented reality: an exploratory study in an industrial workshop. Multimedia Tools and Applications 85, 342 (2026). https://doi.org/10.1007/s11042-026-21516-y

Cyber-human Lab Contributors

Dr Sławomir Tadeja

Dr Slawomir K. Tadeja is a Postdoctoral Associate with the Department of Mechanical Engineering at the Massachusetts Institute of Technology (MIT). Here, he works...

Prof. Thomas Bohné

Thomas Bohné is the founder and head of the Cyber-Human Lab at the University of Cambridge’s Department of Engineering. He is also leading research...