Optimising virtual reality training in industry using crowdsourcing


The ability of Immersive Virtual Reality (IVR) to induce any training scenario in a safe and scalable manner makes it a particularly interesting technology for virtual learning factories. However, both an opportunity and a challenge is to empirically test and optimise virtual environments. Conducting scientifically robust in-person experiments is often not feasible using traditional approaches, given limited resources of training providers and near limitless opportunities to design virtual training environments. Distributed crowdsourcing techniques using Desktop Virtual Reality (DVR) with a PC may offer an alternative and more scalable approach to experimentally test and optimise virtual environments. An interesting question is therefore if such approaches using DVR are a suitable alternative to current experimental designs to enable large-scale optimisation in contexts such as virtual learning factories. While crowdsourcing has been validated for its suitability in several research applications and domains, there is limited research available on training and, to the best of our knowledge, no previous research has evaluated the suitability of crowdsourcing to optimise immersive training in industrial or learning factory contexts. With our paper we contribute the first experiment to address this research gap. Our hypothesis is that crowdsourcing is a suitable technique for IVR training optimisation if it yields equivalent results to traditional experimentation at every training optimisation level. To test this hypothesis we designed an industrial learning experiment to evaluate key performance and affective indicators of IVR training at three levels of optimisation. The experiment was conducted using traditional and crowdsourcing techniques. The results show that crowdsourcing can be a suitable alternative to traditional optimisation techniques depending on: (1) the desired operative mental state of the participants, (2) the investigated key performance indicators, and (3) the kind of optimisation performed. We contribute new data allowing important insights and an integrated training evaluation concept which can be applied when doing crowdsourcing studies.


					@inproceedings{zuercher_2022, title={Optimising virtual reality training in industry using crowdsourcing}, url={https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4075130#}, booktitle={Proceedings of the 12th Conference on Learning Factories (CLF 2022)}, author={Zürcher, Paul-David and Bohné, Thomas and Eger, Vera  Maria and Müller, Felix}, year={2022}, month={Apr}} 
APA Reference

Zürcher, P.D., Bohné, T., Eger, V., & Müller, F. (2022). Optimising virtual reality training in industry using crowdsourcing. In Proceedings of the 12th Conference on Learning Factories (CLF 2022).

Cyber-human Lab Contributors

Paul-David Zürcher

Paul-David Zuercher is a postgraduate researcher at the Cyber-Human lab at the Universiy of Cambridge’s Department of Engineering. His research is focusing on optimisation...

Dr Thomas Bohné

Thomas Bohné is the founder and head of the Cyber-Human Lab at the University of Cambridge’s Department of Engineering. He is also leading research...