A novel approach for detecting deep fake videos using graph neural network

M. M. El-Gayar*, Mohamed Abouhawwash, S. S. Askar, Sara Sweidan

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

24 Scopus citations

Abstract

Deep fake technology has emerged as a double-edged sword in the digital world. While it holds potential for legitimate uses, it can also be exploited to manipulate video content, causing severe social and security concerns. The research gap lies in the fact that traditional deep fake detection methods, such as visual quality analysis or inconsistency detection, need help to keep up with the rapidly advancing technology used to create deep fakes. That means there's a need for more sophisticated detection techniques. This paper introduces an enhanced approach for detecting deep fake videos using graph neural network (GNN). The proposed method splits the detection process into two phases: a mini-batch graph convolution network stream four-block CNN stream comprising Convolution, Batch Normalization, and Activation function. The final step is a flattening operation, which is essential for connecting the convolutional layers to the dense layer. The fusion of these two phases is performed using three different fusion networks: FuNet-A (additive fusion), FuNet-M (element-wise multiplicative fusion), and FuNet-C (concatenation fusion). The paper further evaluates the proposed model on different datasets, where it achieved an impressive training and validation accuracy of 99.3% after 30 epochs.

Original languageEnglish
Article number22
JournalJournal of Big Data
Volume11
Issue number1
DOIs
StatePublished - Dec 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2024, The Author(s).

Keywords

  • Convolutional neural network
  • Deepfake video detection
  • Graph neural network
  • Mini-GNN
  • Multi-task cascaded convolutional neural network

ASJC Scopus subject areas

  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'A novel approach for detecting deep fake videos using graph neural network'. Together they form a unique fingerprint.

Cite this