A single hierarchical network for face, action unit and emotion detection

Shreyank Jyoti, Garima Sharma, Abhinav Dhall

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

3 Citations (Scopus)


The deep neural network shows a consequential performance for a set of specific tasks. A system designed for some correlated task altogether can be feasible for 'in the wild' applications. This paper proposes a method for the face localization, Action Unit (AU) and emotion detection. The three different tasks are performed by a simultaneous hierarchical network which exploits the way of learning of neural networks. Such network can represent more relevant features than the individual network. Due to more complex structures and very deep networks, the deployment of neural networks for real life applications is a challenging task. The paper focuses to find an efficient trade-off between the performance and the complexity of the given tasks. This is done by exploring the advantages of optimization of the network for the given tasks by using separable convolutions, binarization and quantization. Four different databases (AffectNet, EmotioNet, RAF-DB and WiderFace) are used to evaluate the performance of our proposed approach by having a separate task specific database.

Original languageEnglish
Title of host publication2018 International Conference on Digital Image Computing: Techniques and Applications (DICTA)
EditorsManzur Murshed, Manoranjan Paul, Md Asikuzzaman, Mark Pickering, Ambarish Natu, Antonio Robles-Kelly, Shaodi You, Lihong Zheng, Ashfaqur Rahman
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages8
ISBN (Electronic)9781538666029, 9781538666012
ISBN (Print)9781538666036
Publication statusPublished - 2018
Externally publishedYes
EventDigital Image Computing Techniques and Applications 2018 - Canberra, Australia
Duration: 10 Dec 201813 Dec 2018
Conference number: 20th
https://ieeexplore.ieee.org/xpl/conhome/8615628/proceeding (Proceedings)


ConferenceDigital Image Computing Techniques and Applications 2018
Abbreviated titleDICTA 2018
Internet address


  • AU detection
  • Emotion detection
  • Face localization
  • Hierarchical network

Cite this