Deep learning for deepfakes creation and detection: A survey

Thanh Thi Nguyen, Quoc Viet Hung Nguyen, Dung Tien Nguyen, Duc Thanh Nguyen, Thien Huynh-The, Saeid Nahavandi, Thanh Tam Nguyen, Quoc-Viet Pham, Cuong M. Nguyen

Research output: Contribution to journalArticleResearchpeer-review

133 Citations (Scopus)

Abstract

Deep learning has been successfully applied to solve various complex problems ranging from big data analytics to computer vision and human-level control. Deep learning advances however have also been employed to create software that can cause threats to privacy, democracy and national security. One of those deep learning-powered applications recently emerged is deepfake. Deepfake algorithms can create fake images and videos that humans cannot distinguish them from authentic ones. The proposal of technologies that can automatically detect and assess the integrity of digital visual media is therefore indispensable. This paper presents a survey of algorithms used to create deepfakes and, more importantly, methods proposed to detect deepfakes in the literature to date. We present extensive discussions on challenges, research trends and directions related to deepfake technologies. By reviewing the background of deepfakes and state-of-the-art deepfake detection methods, this study provides a comprehensive overview of deepfake techniques and facilitates the development of new and more robust methods to deal with the increasingly challenging deepfakes.

Original languageEnglish
Article number103525
Number of pages14
JournalComputer Vision and Image Understanding
Volume223
DOIs
Publication statusPublished - Oct 2022
Externally publishedYes

Keywords

  • Artificial intelligence
  • Autoencoders
  • Deep learning
  • Deepfakes
  • Face manipulation
  • Forensics
  • GAN
  • Survey

Cite this