Towards Multimodal VR Trainer of Voice Emission and Public Speaking -Work-in-Progress

Abstract

GlossoVR is a virtual reality (VR) application that combines training in public speaking in front of a virtual audience and in voice emission in relaxation exercises. It is accompanied by digital signal processing (DSP) and artificial intelligence (AI) modules which provide automatic feedback on the vocal performance as well as the behavior and psychophysiology of the user. In particular, we address parameters of speech emotions, prosody and timbre, and the user’s hand gestures and eye movement. The prototype is in the proof of concept phase, and we are developing it in accordance with the user-centered design paradigm. In this article reports the work in progress, focusing on the approaches, datasets and algorithms applied in the current state of the glossoVR project.

BibTeX

				
					@INPROCEEDINGS{10108751,
  author={lgras-Cybulska, Magdalena and Hekiert, Daniela and Cybulski, Artur and Tadeja, Slawomir and Witkowski, Marcin and Nakonieczny, Konrad and Augustyn, Izabela and Jasinski, Jan and Hemmerling, Daria and Skrzek, Tomasz and Kacprzak, Stanislaw and Kaczorowska, Magdalena and Juros, Julia and Warzeszka, Marek and Migaczewska, Ewa and Malawski, Filip and Slomka, Paulina and Salamon, Rafal and Szumiec, Aleksandra and Kornacka, Kinga and Blaszczyński, Bartlomiej and Blaszczyńska, Katarzyna and Sterna, Radoslaw and Makowiec, Marek and Maidak, Magdalena},
  booktitle={2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)}, 
  title={Towards Multimodal VR Trainer of Voice Emission and Public Speaking -Work-in-Progress}, 
  year={2023},
  volume={},
  number={},
  pages={355-359},
  doi={10.1109/VRW58643.2023.00079}}
				
			
APA Reference

M. Igras-Cybulska et al., “Towards Multimodal VR Trainer of Voice Emission and Public Speaking -Work-in-Progress,” 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Shanghai, China, 2023, pp. 355-359, doi: 10.1109/VRW58643.2023.00079.

Cyber-human Lab Contributors

Dr Sławomir Tadeja

Slawomir K. Tadeja is a postdoctoral research associate in the Cyber-Human Lab belonging to the Institute of Manufacturing at the University of Cambridge. Previously...