AdverFacial: privacy-preserving universal adversarial perturbation against facial micro-expression leakages

Yin Yin Low, Angeline Tanvy, Raphaël C.W. Phan, Xiaojun Chang

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

3 Citations (Scopus)

Abstract

Privacy safeguards are crucial, notably now with increased virtual conferencing usage during the Covid pandemic. In contrast to conventional facial expressions that are visually obvious to humans, micro-expressions are involuntary and transient facial expressions, commonly manifested involuntarily when we aim to withhold our emotions. Advanced micro-expression recognition techniques exist that can reveal the genuine emotions that people attempt to conceal, thus threatening individual emotional privacy, as fundamental human rights would dictate that one should have a choice of what emotion is being shown or not shown. We propose the novel universal adversarial perturbation-based approach - AdverFacial - for privacy concealment against automated micro-expression analysis via deep learning techniques. We derive the optimal strategy to achieve micro-expression misclassification with a high success rate, low perceptibility and cross neural network transferability. We perform experiments on two popular datasets with state-of-the-art microexpression spotting and recognition models and demonstrate our approach's effectiveness in emotional concealment.

Original languageEnglish
Title of host publication2022 IEEE International Conference on Acoustics, Speech, and Signal Processing - Proceedings
EditorsKenneth Lam, Berrak Sisman, Yan Sun
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages2754-2758
Number of pages5
ISBN (Electronic)9781665405409
ISBN (Print)9781665405416
DOIs
Publication statusPublished - 2022
EventIEEE International Conference on Acoustics, Speech, and Signal Processing 2022 - Online, Singapore
Duration: 23 May 202227 May 2022
Conference number: 47th
https://ieeexplore.ieee.org/xpl/conhome/9745891/proceeding (Proceedings)

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
PublisherIEEE, Institute of Electrical and Electronics Engineers
Volume2022-May
ISSN (Print)1520-6149
ISSN (Electronic)2379-190X

Conference

ConferenceIEEE International Conference on Acoustics, Speech, and Signal Processing 2022
Abbreviated titleICASSP 2022
Country/TerritorySingapore
Period23/05/2227/05/22
Internet address

Keywords

  • emotional privacy
  • Micro-expression recognition
  • universal adversarial patterns
  • withhold-ment

Cite this