Deepfake video detection using Spatiotemporal Convolutional Network and Photo Response Non Uniformity

Sio Jurnalis Pipin, Ronsen Purba, Muhammad Fermi Pasha

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearch

11 Citations (Scopus)

Abstract

It is important to improve the detection of deepfake videos to differentiate between real and fake videos that cause disinformation in the digital age so that a high level of accuracy is required. The purpose of deepfake video detection is to aid digital content consumers to surmount disinformation and sever real videos from fake ones. Limited by the number and quality of datasets, the time required for detection, and consistent performance evaluation i.e., the detection model cannot detect videos detected with video editing tools. This study provides a solution to this problem by using the Spatiotemporal Convolutional Network (SCN) method and Photo-Response Non-Uniformity (PRNU) analysis. The dataset used will go through pre-processing stages, extract per-frame video, detect face parts, and face cropping. Then the data is spread and modeled using RestNext50 and LSTM. This study produced 10 models using the FaceForensic, CelebDF, and DFDC datasets, and a mixture of these datasets which can then be used to analyze deepfake videos. The test results show that the deepfake detection process is faster and more accurate with an accuracy rate of up to 97.89%.

Original languageEnglish
Title of host publicationICOSNIKOM 2022 - 2022 IEEE International Conference of Computer Science and Information Technology
EditorsRossianna Dewi Sri Hutabarat, Martha B. Napitupulu, Samuel Christy Angie Sihotang, Theresya Gurning
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9798350399073
ISBN (Print)9798350399080
DOIs
Publication statusPublished - 2022
EventIEEE International Conference of Computer Science and Information Technology 2022 - Online, Sumatera Utara, Indonesia
Duration: 20 Oct 202221 Oct 2022
Conference number: 4th
https://ieeexplore.ieee.org/xpl/conhome/10034843/proceeding (Proceedings)
https://icosnikom2022.del.ac.id/ (Website)

Conference

ConferenceIEEE International Conference of Computer Science and Information Technology 2022
Abbreviated titleICOSNIKOM 2022
Country/TerritoryIndonesia
CitySumatera Utara
Period20/10/2221/10/22
Internet address

Keywords

  • deepfake
  • deepfake video detection
  • photo-response non uniformity (PRNU)
  • SCN

Cite this