Skip to main navigation Skip to search Skip to main content

Transformer-Based Ensemble Approach for Robust Deepfake Detection in Low-Resolution Short Videos

  • Sunway University
  • University of Aleppo

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

Abstract

Deepfake technology - synthetic media that replaces a person's likeness in existing images or videos - has raised significant concerns in politics, security, and the media. Recent advances such as ChatGPT 4.0 have further magnified the potential misuse of these synthetic artifacts, making it increasingly challenging to detect maliciously manipulated short videos. This paper proposes a deepfake detection framework to address challenges in low-resolution, compressed, and short video scenarios. The methodology leverages Haar Cascade for face detection, a Vision Transformer (ViT) for feature extraction, and an ensemble classifier (Support Vector Machines, Random Forest, Logistic Regression) for final data modelling. Our result findings underline how high compression, video distortions, and limited training data affect detection accuracy. Experiments on Celeb-DF (v2) and DeeperForensics-1.0 datasets reveal that our proposed method balances computational efficiency and robust detection, outperforming cutting-edge Convolutional Neural Network-based models (e.g., MesoNet) on selected metrics and data partitions. Subsequently, our findings revealed that the proposed ensemble model achieves high accuracy of 74% in detecting the deepfake content on the Celeb-DF (Version 2) and DeeperForensics-1.0 datasets. By focusing on spatial anomalies and practical constraints such as short video duration, this work contributes to a valuable understanding of these constraints and the scalability of the existing approaches.

Original languageEnglish
Title of host publication2025 21st IEEE International Colloquium on Signal Processing and Its Applications, CSPA 2025 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages307-312
Number of pages6
Edition2025
ISBN (Electronic)9798331522193
DOIs
Publication statusPublished - 2025
Event21st IEEE International Colloquium on Signal Processing and Its Applications, CSPA 2025 - Pulau Pinang, Malaysia
Duration: 7 Feb 2025 → 8 Feb 2025

Conference

Conference21st IEEE International Colloquium on Signal Processing and Its Applications, CSPA 2025
Country/TerritoryMalaysia
CityPulau Pinang
Period7/02/25 → 8/02/25

Keywords

  • convolutional neural network
  • deep learning
  • deepfake
  • ensemble models
  • transformer

Fingerprint

Dive into the research topics of 'Transformer-Based Ensemble Approach for Robust Deepfake Detection in Low-Resolution Short Videos'. Together they form a unique fingerprint.

Cite this