2023

Using AR and YOLOv8-Based Object Detection to Support Real-World Visual Search in Industrial Workshop: Lessons Learned from a Pilot Study

Mikołaj Łysakowski; Kamil Żywanowski; Adam Banaszczyk; Michał R. Nowicki; Piotr Skrzypczyński; Sławomir Konrad Tadeja

Abstract

Visual search requires focused attention to distinguish the target object from its surroundings. This task is increasingly more difficult when searching for a given object within a messy industrial workshop. Thus, we explored how we can support visual search with the help of an augmented reality (AR) head-mounted display (HMD) running YOLOv8 object detection model. We report on the results from a pilot user study with eleven participants tasked with searching for a series of objects in a real-world workshop. Consequently, we reflect on lessons learned concerning the experimental setup with AR interface enhanced with Segment Anything Model (SAM) for YOLOv8 training.

BibTeX

				
					@INPROCEEDINGS{10322214,
  author={Łysakowski, Mikołaj and Żywanowski, Kamil and Banaszczyk, Adam and Nowicki, Michał R. and Skrzypczyński, Piotr and Tadeja, Sławomir Konrad},
  booktitle={2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)}, 
  title={Using AR and YOLOv8-Based Object Detection to Support Real-World Visual Search in Industrial Workshop: Lessons Learned from a Pilot Study}, 
  year={2023},
  volume={},
  number={},
  pages={154-158},
  doi={10.1109/ISMAR-Adjunct60411.2023.00039}}

Copy the above and convert to citation here

APA Reference

M. Łysakowski, K. Żywanowski, A. Banaszczyk, M. R. Nowicki, P. Skrzypczyński and S. K. Tadeja, “Using AR and YOLOv8-Based Object Detection to Support Real-World Visual Search in Industrial Workshop: Lessons Learned from a Pilot Study,” 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Sydney, Australia, 2023, pp. 154-158, doi: 10.1109/ISMAR-Adjunct60411.2023.00039.

DOI

10.1109/ISMAR-Adjunct60411.2023.00039

Cyber-human Lab Contributors

Dr Sławomir Tadeja

Slawomir K. Tadeja is a postdoctoral research associate in the Cyber-Human Lab belonging to the Institute of Manufacturing at the University of Cambridge. Previously,...