Depression analysis: a multimodal approach

Jyoti Joshi

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

6 Citations (Scopus)


Depression is a severe mental health disorder causing high societal costs. Current clinical practice depends almost exclusively on self report and clinical opinion, risking a range of subjective biases. It is therefore useful to design a diagnostic aid to assist clinicians. This project aims at developing a novel multimodal framework for depression analysis. In this PhD work, it is hypothesized that a multimodal affective sensing system can better capture what characterises a person's affective state than single modality systems. The project will explore facial dynamics, head movements, upper body gestures, EEG measures and speech characteristics related to affect, in subjects with major depressive disorders. Integrating the individual sensing modalities, a multimodal approach that show improved performance characteristics over single modality approaches will be developed.

Original languageEnglish
Title of host publicationICMI'12 - Proceedings of the ACM International Conference on Multimodal Interaction
PublisherAssociation for Computing Machinery (ACM)
Number of pages4
ISBN (Print)9781450314671
Publication statusPublished - 2012
Externally publishedYes
EventInternational Conference on Multimodal Interfaces 2012 - Santa Monica, United States of America
Duration: 22 Oct 201226 Oct 2012
Conference number: 14th (Proceedings)


ConferenceInternational Conference on Multimodal Interfaces 2012
Abbreviated titleICMI 2012
Country/TerritoryUnited States of America
CitySanta Monica
Internet address


  • Affective computing
  • Depression analysis
  • Multimodal framework

Cite this