Learning conditional latent structures from multiple data sources

Viet Huynh, Dinh Phung, Long Nguyen, Svetha Venkatesh, Hung H. Bui

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

4 Citations (Scopus)

Abstract

Data usually present in heterogeneous sources. When dealing with multiple data sources, existing models often treat them independently and thus can not explicitly model the correlation structures among data sources. To address this problem, we propose a full Bayesian nonparametric approach to model correlation structures among multiple and heterogeneous datasets. The proposed framework, first, induces mixture distribution over primary data source using hierarchical Dirichlet processes (HDP). Once conditioned on each atom (group) discovered in previous step, context data sources are mutually independent and each is generated from hierarchical Dirichlet processes. In each specific application, which covariates constitute content or context(s) is determined by the nature of data. We also derive the efficient inference and exploit the conditional independence structure to propose (conditional) parallel Gibbs sampling scheme. We demonstrate our model to address the problem of latent activities discovery in pervasive computing using mobile data. We show the advantage of utilizing multiple data sources in terms of exploratory analysis as well as quantitative clustering performance.

Original languageEnglish
Title of host publicationAdvances in Knowledge Discovery and Data Mining
Subtitle of host publication19th Pacific-Asia Conference, PAKDD 2015, Ho Chi Minh City, Vietnam, May 19–22, 2015 Proceedings, Part 1
EditorsTru Cao , Ee-Peng Lim, Zhi-Hua Zhou , Tu-Bao Ho, David Cheung , Hiroshi Motoda
Place of PublicationCham Switzerland
PublisherSpringer
Pages343-354
Number of pages12
ISBN (Print)9783319180373
DOIs
Publication statusPublished - 2015
Externally publishedYes
EventPacific-Asia Conference on Knowledge Discovery and Data Mining 2015 - Ho Chi Minh City, Vietnam
Duration: 19 May 201522 May 2015
Conference number: 19th
https://web.archive.org/web/20150429212339/http://www.pakdd2015.jvn.edu.vn/
https://link.springer.com/book/10.1007/978-3-319-18038-0

Publication series

NameLecture Notes in Artificial Intelligence
PublisherSpringer
Volume9077
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferencePacific-Asia Conference on Knowledge Discovery and Data Mining 2015
Abbreviated titlePAKDD 2015
CountryVietnam
CityHo Chi Minh City
Period19/05/1522/05/15
Internet address

Cite this

Huynh, V., Phung, D., Nguyen, L., Venkatesh, S., & Bui, H. H. (2015). Learning conditional latent structures from multiple data sources. In T. Cao , E-P. Lim, Z-H. Zhou , T-B. Ho, D. Cheung , & H. Motoda (Eds.), Advances in Knowledge Discovery and Data Mining : 19th Pacific-Asia Conference, PAKDD 2015, Ho Chi Minh City, Vietnam, May 19–22, 2015 Proceedings, Part 1 (pp. 343-354). (Lecture Notes in Artificial Intelligence ; Vol. 9077). Springer. https://doi.org/10.1007/978-3-319-18038-0_27