Zero-shot slot filling via latent question representation and reading comprehension

Tongtong Wu, Meng Wang, Huan Gao, Guilin Qi, Weizhuo Li

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Slot filling is a demanding task of knowledge base population, which aims to extract facts about particular entities from unstructured text automatically. Most of the existing approaches rely on pre-trained extraction models which may suffer from robustness caused by unseen slots, or the so-called zero-shot slot filling problem. Recent studies try to reduce the slot filling to a machine reading comprehension task and achieve certain improvements on unseen slots, but they still face challenges to generate appropriate questions for models and find the right answers. In this paper, we propose a novel end-to-end approach to address the zero-shot slot filling by unifying the natural language question generation and machine reading comprehension. Especially, we explore how to learn a well-organized latent question representation by incorporating external knowledge. We conduct extensive experiments to validate the effectiveness of our model. Experimental results show that the proposed approach outperforms the state-of-the-art baseline methods in zero-shot scenarios.

Original languageEnglish
Title of host publicationPRICAI 2019: Trends in Artificial Intelligence - 16th Pacific Rim International Conference on Artificial Intelligence Cuvu, Yanuca Island, Fiji, August 26–30, 2019 Proceedings, Part III
EditorsAbhaya C. Nayak, Alok Sharma
Place of PublicationCham Switzerland
PublisherSpringer
Pages123-136
Number of pages14
ISBN (Electronic)9783030298944
ISBN (Print)9783030298937
DOIs
Publication statusPublished - 2019
Externally publishedYes
EventPacific Rim International Conference on Artificial Intelligence 2019 - Yanuka Island, Fiji
Duration: 26 Aug 201930 Aug 2019
Conference number: 16th
https://link.springer.com/book/10.1007/978-3-030-29894-4 (Proceedings)
https://www.pricai.org/2019/ (Website)

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume11672
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferencePacific Rim International Conference on Artificial Intelligence 2019
Abbreviated titlePRICAI 2019
Country/TerritoryFiji
CityYanuka Island
Period26/08/1930/08/19
Internet address

Keywords

  • Reading comprehension
  • Slot filling
  • Zero-shot learning

Cite this