Handling missing data in medical questionnaires using tensor decompositions

Justin Dauwels, Lalit Garg, Arul Earnest, Leong Khai Pang

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

4 Citations (Scopus)

Abstract

Questionnaires are often used to understand the quality of life of patients, treatment and disease burden and to obtain their feedback on the provided health care. However, a common problem with questionnaires is missing data. Some level of missing data is common and unavoidable. For example, patients may elect to leave one or more items unanswered either inadvertently or because they feel inhibited in responding to items dealing with a sensitive topic. Such missing data may lead to biased parameter estimates and inflated errors. In this paper, we propose an innovative collaborative filtering technique to complete missing data in medical questionnaires. The proposed technique is based on canonical tensor decomposition (CANDECOMP) and parallel factor decomposition (PARAFAC). It is very fast and effective especially with repeated medical questionnaires. To assess the different algorithms and our methods, we used SLEQOL questionnaires (systemic lupus erythematosus-specific quality-of-life instrument) completed by one hundred patients from TTSH and hospitals in China and Vietnam. Our results demonstrate that the tensor decomposition based method provides significant improvement on many existing methods and overcome their limitations in terms of various statistical measures.

Original languageEnglish
Title of host publicationICICS 2011 - 8th International Conference on Information, Communications and Signal Processing
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages5
ISBN (Print)9781457700309
DOIs
Publication statusPublished - 2011
Externally publishedYes
EventInternational Conference on Information, Communications and Signal Processing 2011 - Shangri-La Hotel, Singapore, Singapore
Duration: 13 Dec 201116 Dec 2011
Conference number: 8th
https://www.ieee.org/conferences_events/conferences/conferencedetails/index.html%3FConf_ID%3D18633
http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=6165552 (IEEE Conference Proceedings)

Conference

ConferenceInternational Conference on Information, Communications and Signal Processing 2011
Abbreviated titleICICS 2011
CountrySingapore
CitySingapore
Period13/12/1116/12/11
Internet address

Keywords

  • CANDECOMP/PARAFAC (CP)
  • medical questionnaires
  • missing data analysis
  • tensor decomposition
  • tensor factorization

Cite this