Real-time stress detection model and voice analysis: an integrated VR based game for training public speaking skills
Arushi, Dillon, Roberto, and Teoh, Ai Ni (2021) Real-time stress detection model and voice analysis: an integrated VR based game for training public speaking skills. In: Proceedings of the 3rd IEEE Conference on Games. From: 3rd IEEE Conference on Games, 17-20 August 2021, Copenhagen, Denmark.
![[img]](https://researchonline.jcu.edu.au/style/images/fileicons/application_pdf.png) |
PDF (Accepted Publisher Version)
- Accepted Version
Restricted to Repository staff only |
Abstract
This paper describes a work in progress Virtual Reality (VR) based serious game, integrated with algorithmic classification model for detecting stress during public speaking in real-time by analysing the speaker’s voice. The designed VR game offers real-time virtual social support/feedback for the training of public speaking skills. We developed a stress detection model that recognises stress and an altered normal confident state based on 24 actors’ voice expressions from the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS). Three different classifiers model are constructed for each actor by extracting and identifying overall significant voice features. The results shows that random forest classification using features Amplitude Envelope (AE), Root-Mean Square (RMS), and Mel-Frequency Cepstral Coefficients (MFCCs) provides high accuracy for detection of stress, while many more features can possibly be explored.
| Item ID: | 69269 |
|---|---|
| Item Type: | Conference Item (Research - E1) |
| Related URLs: | |
| Copyright Information: | © 2021 IEEE |
| Date Deposited: | 01 Dec 2021 02:50 |
| FoR Codes: | 46 INFORMATION AND COMPUTING SCIENCES > 4611 Machine learning > 461199 Machine learning not elsewhere classified @ 25% 46 INFORMATION AND COMPUTING SCIENCES > 4603 Computer vision and multimedia computation > 460302 Audio processing @ 25% 46 INFORMATION AND COMPUTING SCIENCES > 4607 Graphics, augmented reality and games > 460708 Virtual and mixed reality @ 50% |
| SEO Codes: | 16 EDUCATION AND TRAINING > 1699 Other education and training > 169999 Other education and training not elsewhere classified @ 100% |
| Downloads: |
Total: 1 |
| More Statistics |
Actions (Repository Staff Only)
 |
Item Control Page |