Neural-net classification for spatio-temporal descriptor based depression analysis

Jyoti Joshi, Abhinav Dhall, Roland Goecke, Michael Breakspear, Gordon Parker

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

32 Citations (Scopus)


Depression is a severe psychiatric disorder. Despite the high prevalence, current clinical practice depends almost exclusively on self-report and clinical opinion, risking a range of subjective biases. This paper focuses on depression analysis based on visual cues from facial expressions and upper body movements. The proposed diagnostic support system is based on computing spatio-temporal features from video sequences. Space Time Interest Points are computed for the videos for analysing the upper body movements and a temporal visual words dictionary is learned from them. Intra-facial muscle movement is captured by computing a LBP-TOP based codebook. Various neural-net classifiers are explored and compared with a SVM. The approach is evaluated on real-world clinical data from interactive interviews with depressed and healthy subjects.

Original languageEnglish
Title of host publicationICPR 2012 - 21st International Conference on Pattern Recognition
Number of pages5
Publication statusPublished - 1 Dec 2012
Externally publishedYes
EventInternational Conference on Pattern Recognition 2012 - Tsukuba, Japan
Duration: 11 Nov 201215 Nov 2012
Conference number: 21st (Proceedings)

Publication series

NameProceedings - International Conference on Pattern Recognition
ISSN (Print)1051-4651


ConferenceInternational Conference on Pattern Recognition 2012
Abbreviated titleICPR 2012
Internet address

Cite this