2023

Towards Multimodal VR Trainer of Voice Emission and Public Speaking -Work-in-Progress

Magdalena Igras-Cybulska, Daniela Hekiert, Artur Cybulski, Slawomir Tadeja et al.

Abstract

GlossoVR is a virtual reality (VR) application that combines training in public speaking in front of a virtual audience and in voice emission in relaxation exercises. It is accompanied by digital signal processing (DSP) and artificial intelligence (AI) modules which provide automatic feedback on the vocal performance as well as the behavior and psychophysiology of the user. In particular, we address parameters of speech emotions, prosody and timbre, and the user’s hand gestures and eye movement. The prototype is in the proof of concept phase, and we are developing it in accordance with the user-centered design paradigm. In this article reports the work in progress, focusing on the approaches, datasets and algorithms applied in the current state of the glossoVR project.

BibTeX

				
					@INPROCEEDINGS{10108751,
  author={lgras-Cybulska, Magdalena and Hekiert, Daniela and Cybulski, Artur and Tadeja, Slawomir and Witkowski, Marcin and Nakonieczny, Konrad and Augustyn, Izabela and Jasinski, Jan and Hemmerling, Daria and Skrzek, Tomasz and Kacprzak, Stanislaw and Kaczorowska, Magdalena and Juros, Julia and Warzeszka, Marek and Migaczewska, Ewa and Malawski, Filip and Slomka, Paulina and Salamon, Rafal and Szumiec, Aleksandra and Kornacka, Kinga and Blaszczyński, Bartlomiej and Blaszczyńska, Katarzyna and Sterna, Radoslaw and Makowiec, Marek and Maidak, Magdalena},
  booktitle={2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)}, 
  title={Towards Multimodal VR Trainer of Voice Emission and Public Speaking -Work-in-Progress}, 
  year={2023},
  volume={},
  number={},
  pages={355-359},
  doi={10.1109/VRW58643.2023.00079}}

Copy the above and convert to citation here

APA Reference

M. Igras-Cybulska et al., “Towards Multimodal VR Trainer of Voice Emission and Public Speaking -Work-in-Progress,” 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Shanghai, China, 2023, pp. 355-359, doi: 10.1109/VRW58643.2023.00079.

DOI

10.1109/VRW58643.2023.00079

Cyber-human Lab Contributors

Dr Sławomir Tadeja

Dr Slawomir K. Tadeja is a Postdoctoral Associate with the Department of Mechanical Engineering at the Massachusetts Institute of Technology (MIT). Here, he works...