Streaming variational inference for dirichlet process mixtures

Viet Huynh, Dinh Phung, Svetha Venkatesh

Research output: Chapter in Book/Report/Conference proceedingConference PaperOtherpeer-review

8 Citations (Scopus)

Abstract

Bayesian nonparametric models are theoretically suitable to learn streaming data due to their complexity relaxation to the volume of observed data. However, most of the existing variational inference algorithms are not applicable to streaming applications since they require truncation on variational distributions. In this paper, we present two truncation-free variational algorithms, one for mix-membership inference called TFVB (truncation-free variational Bayes), and the other for hard clustering inference called TFME (truncation-free maximization expectation). With these algorithms, we further developed a streaming learning framework for the popular Dirichlet process mixture (DPM) models. Our experiments demonstrate the usefulness of our framework in both synthetic and real-world data.

Original languageEnglish
Title of host publicationProceedings of Machine Learning Research
Subtitle of host publicationAsian Conference on Machine Learning, 20-22 November 2015, Hong Kong
EditorsGeoffrey Holmes, Tie-Yan Liu
Place of PublicationUSA
PublisherProceedings of Machine Learning Research (PMLR)
Pages237-252
Number of pages16
Volume45
Publication statusPublished - 1 Jan 2015
Externally publishedYes
EventAsian Conference on Machine Learning 2015 - Hong Kong, Hong Kong
Duration: 20 Nov 201522 Nov 2015
Conference number: 7th
http://acml-conf.org/2015/acml.php (Conference website)
http://proceedings.mlr.press/v45/ (Proceedings)

Publication series

NameProceedings of Machine Learning Research
Volume45
ISSN (Print)1938-7228

Conference

ConferenceAsian Conference on Machine Learning 2015
Abbreviated titleACML 2015
Country/TerritoryHong Kong
CityHong Kong
Period20/11/1522/11/15
Internet address

Cite this