Geometric enclosing networks

Trung Le, Hung Vu, Tu Dinh Nguyen, Dinh Phung

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

2 Citations (Scopus)

Abstract

Training model to generate data has increasingly attracted research attention and become important in modern world applications. We propose in this paper a new geometry-based optimization approach to address this problem. Orthogonal to current state-of-the-art density-based approaches, most notably VAE and GAN, we present a fresh new idea that borrows the principle of minimal enclosing ball to train a generator G (z) in such a way that both training and generated data, after being mapped to the feature space, are enclosed in the same sphere. We develop theory to guarantee that the mapping is bijective so that its inverse from feature space to data space results in expressive nonlinear contours to describe the data manifold, hence ensuring data generated are also lying on the data manifold learned from training data. Our model enjoys a nice geometric interpretation, hence termed Geometric Enclosing Networks (GEN), and possesses some key advantages over its rivals, namely simple and easy-to-control optimization formulation, avoidance of mode collapsing and efficiently learn data manifold representation in a completely unsupervised manner. We conducted extensive experiments on synthesis and real-world datasets to illustrate the behaviors, strength and weakness of our proposed GEN, in particular its ability to handle multi-modal data and quality of generated data.

Original languageEnglish
Title of host publicationProceedings of the 27th International Joint Conference on Artificial Intelligence, IJCAI 2018
EditorsJerome Lang
Place of PublicationMarina del Rey CA USA
PublisherAssociation for the Advancement of Artificial Intelligence (AAAI)
Pages2355-2361
Number of pages7
ISBN (Electronic)9780999241127
DOIs
Publication statusPublished - 2018
EventInternational Joint Conference on Artificial Intelligence 2018 - Stockholm, Sweden
Duration: 13 Jul 201819 Jul 2018
https://www.ijcai.org/proceedings/2018/

Conference

ConferenceInternational Joint Conference on Artificial Intelligence 2018
Abbreviated titleIJCAI 2018
CountrySweden
CityStockholm
Period13/07/1819/07/18
Internet address

Keywords

  • Machine Learning
  • Kernel Methods
  • Learning Generative Models

Cite this

Le, T., Vu, H., Nguyen, T. D., & Phung, D. (2018). Geometric enclosing networks. In J. Lang (Ed.), Proceedings of the 27th International Joint Conference on Artificial Intelligence, IJCAI 2018 (pp. 2355-2361). Association for the Advancement of Artificial Intelligence (AAAI). https://doi.org/10.24963/ijcai.2018/326