Hybrid CNN-LSTM Speaker Identification Framework for Evaluating the Impact of Face Masks

Mohamed Bader, Ismail Shahin, Abdelfatah Ahmed, Naoufel Werghi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

Following the declaration of COVID-19 as a worldwide pandemic, hindering a multitude number of lives, face mask exploitation has become extremely crucial to barricade the emanation of the virus. The masks available in the market are of various sorts and materials and tend to affect the speaker's vocal characteristics. As a result, optimum communication may be hampered. In the proposed framework, a speaker identification model has been employed. Also, the speech corpus has been captured. Then, the spectrograms were obtained and passed through a two-stage pre-processing. The first stage includes the audio samples. In contrast, the second stage has targeted the spectrograms. Afterward, the generated spectrograms were passed into a hybrid Convolutional Neural Network- Long Short-Term Memory (CNN-LSTM) model to perform the classification. Our proposed framework has shown its capability to identify speakers while they are wearing face masks. Moreover, the system has been evaluated on the collected dataset, where it has attained 92.7%, 92.62%, 87.71%, and 88.26% in terms of accuracy, precision, recall, and F1-score, respectively. The acquired findings are still preliminary and will be refined further in the future by data expansion and the employment of numerous optimization approaches.

Original languageBritish English
Title of host publication2022 International Conference on Electrical and Computing Technologies and Applications, ICECTA 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages118-121
Number of pages4
ISBN (Electronic)9781665456005
DOIs
StatePublished - 2022
Event2022 International Conference on Electrical and Computing Technologies and Applications, ICECTA 2022 - Ras Al Khaimah, United Arab Emirates
Duration: 23 Nov 202225 Nov 2022

Publication series

Name2022 International Conference on Electrical and Computing Technologies and Applications, ICECTA 2022

Conference

Conference2022 International Conference on Electrical and Computing Technologies and Applications, ICECTA 2022
Country/TerritoryUnited Arab Emirates
CityRas Al Khaimah
Period23/11/2225/11/22

Keywords

  • CNN
  • COVID-19
  • Face Masks
  • LSTM
  • Speaker Identification

Fingerprint

Dive into the research topics of 'Hybrid CNN-LSTM Speaker Identification Framework for Evaluating the Impact of Face Masks'. Together they form a unique fingerprint.

Cite this