Interpreting abnormality of a complex static scene using generative adversarial network

Mahamat Moussa, Chern Hong Lim

    Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review


    Anomaly detection remains a difficult task in the computer vision and image processing field. Although several studies have been done to address this challenge, most of these studies focused on analyzing temporal features to determine abnormality. Examples of temporal features include behavioral changes and new object appearance in the target scene. In this paper, we are interpreting abnormality from a new perspective, which is static and complex image scene that focused on one object (airplane) using generative adversarial networks (GANs). Our interpretation of abnormality in such image intended to test two research hypotheses: 1) whether GANs can capture the cognitive features of abnormality from within a complex scene. 2) whether GANs can be used to generate more reliable datasets of abnormal scenes. In this work, we chose an airplane as the object of our experiment. We defined abnormal and normal scenes as follow: The scene is abnormal if the airplane involved in accidents (such as crash or fire), and normal otherwise (such as flying or landed airplane). A custom dataset is built for this experiment and it consists of two classes; normal and abnormal. We augmented each class to the double of its size using GANs, and then we created three different sets of datasets: (DS1, DS2, and DS3) to test our hypotheses. We applied four different supervised machine learning classifiers on each of these three sets, we repeated this step 3 times as follow: 1) pixel-based, 2) with applying Principal Component Analysis (PCA), and 3) with applying Local Binary Pattern (LBP). The overall results showed that GANs possess the capability of generating images that capture the abnormality features from the static complex scene.

    Original languageEnglish
    Title of host publication2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2019)
    EditorsTatsuya Kawahara, Jiangyan Yi
    Place of PublicationPiscataway NJ USA
    PublisherIEEE, Institute of Electrical and Electronics Engineers
    Number of pages5
    ISBN (Electronic)9781728132488
    ISBN (Print)9781728132495
    Publication statusPublished - 2019
    EventAnnual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA) 2019 - Lanzhou, China
    Duration: 18 Nov 201921 Nov 2019 (Proceedings) (Website)

    Publication series

    Name2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2019
    PublisherInstitute of Electrical and Electronics Engineers, Inc.
    ISSN (Print)2640-009X
    ISSN (Electronic)2640-0103


    ConferenceAnnual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA) 2019
    Abbreviated titleAPSIPA ASC 2019
    Internet address

    Cite this