Skip to main navigation Skip to search Skip to main content

Fake speech detection using VGGish with attention block

  • Tahira Kanwal
  • , Rabbia Mahum*
  • , Abdul Malik AlSalman
  • , Mohamed Sharaf
  • , Haseeb Hassan
  • *Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

22 Scopus citations

Abstract

While deep learning technologies have made remarkable progress in generating deepfakes, their misuse has become a well-known concern. As a result, the ubiquitous usage of deepfakes for increasing false information poses significant risks to the security and privacy of individuals. The primary objective of audio spoofing detection is to identify audio generated through numerous AI-based techniques. Several techniques for fake audio detection already exist using machine learning algorithms. However, they lack generalization and may not identify all types of AI-synthesized audios such as replay attacks, voice conversion, and text-to-speech (TTS). In this paper, a deep layered model, i.e., VGGish, along with an attention block, namely Convolutional Block Attention Module (CBAM) for spoofing detection, is introduced. Our suggested model successfully classifies input audio into two classes: Fake and Real, converting them into mel-spectrograms, and extracting their most representative features due to the attention block. Our model is a significant technique to utilize for audio spoofing detection due to a simple layered architecture. It captures complex relationships in audio signals due to both spatial and channel features present in an attention module. To evaluate the effectiveness of our model, we have conducted in-depth testing using the ASVspoof 2019 dataset. The proposed technique achieved an EER of 0.52% for Physical Access (PA) attacks and 0.07 % for Logical Access (LA) attacks.

Original languageEnglish
Article number35
JournalEurasip Journal on Audio, Speech, and Music Processing
Volume2024
Issue number1
DOIs
StatePublished - Dec 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© The Author(s) 2024.

Keywords

  • ASVspoof
  • Attention module
  • CBAM
  • Deep learning
  • Deepfake
  • Synthetic audios
  • VGGish

ASJC Scopus subject areas

  • Acoustics and Ultrasonics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Fake speech detection using VGGish with attention block'. Together they form a unique fingerprint.

Cite this