Publications / 2024
Deep Multiresolution Wavelet Transform for Speech Emotion Assessment of High-Risk Suicide Callers
Abstract
This paper introduces an end-to-end (E2E) deep learning framework for speech emotion recognition (SER), aimed at assisting suicide helpline counselors during their interventions. Despite progress, SER still faces challenges such as system complexity, feature distinctiveness, and noise interference. Our approach uses a learnable architecture for fast discrete wavelet transform (FDWT) multi-resolution analysis, for directly extracting features from raw speech waveforms. It combines a 1D dilated convolutional neural network (1D dilated CNN) with spatial attention (SA) and bidirectional gated recurrent units (Bi-GRU) with temporal attention (TA) to capture spatial and temporal characteristics. The framework handles variable-length speech without segmentation, simplifying preprocessing. It introduces a learnable architecture for wavelet bases and coefficient denoising with a learnable asymmetric hard thresholding (LAHT) activation function, enhancing noise resilience and feature distinctiveness. We validate our model on the NSPL-CRISE dataset, which includes recordings from individuals with psychological challenges and potentially suicidal ideations. Our results show significant performance improvements over state-of-the-art SER methods, demonstrating the effectiveness of our multi-resolution deep learning framework in identifying emotional states related to suicide risk.
Citation and BibTeX
Alaa Nfissi, Wassim Bouachir, Nizar Bouguila, Brian Mishara. (2024). Deep Multiresolution Wavelet Transform for Speech Emotion Assessment of High-Risk Suicide Callers. Artificial Neural Networks in Pattern Recognition (ANNPR 2024), 256–268. https://doi.org/10.1007/978-3-031-71602-7_22
@inproceedings{nfissi-deep-multiresolution-wavelets-2024,
title = {Deep Multiresolution Wavelet Transform for Speech Emotion Assessment of High-Risk Suicide Callers},
author = {Nfissi, Alaa and Bouachir, Wassim and Bouguila, Nizar and Mishara, Brian},
year = {2024},
booktitle = {Artificial Neural Networks in Pattern Recognition (ANNPR 2024)},
doi = {10.1007/978-3-031-71602-7_22},
url = {https://doi.org/10.1007/978-3-031-71602-7_22},
pages = {256--268}
}Research projects
- 01
Projects
Adaptive time-frequency learning
A research file connecting learned wavelets, wavelet packets, denoising and fractional superlets.
Research programs
- 01
Research programs
Learnable signal representations
Wavelets, wavelet packets and fractional superlets as adaptive representations for emotion analysis and speech enhancement.
Code
- 01
Repositories
Deep multiresolution wavelet analysis
Research code associated with adaptive time-frequency learning.