Normalizing flow-based neural process for few-shot knowledge graph completion

Linhao Luo, Yuan Fang Li, Gholamreza Haffari, Shirui Pan

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

29 Citations (Scopus)

Abstract

Knowledge graphs (KGs), as a structured form of knowledge representation, have been widely applied in the real world. Recently, few-shot knowledge graph completion (FKGC), which aims to predict missing facts for unseen relations with few-shot associated facts, has attracted increasing attention from practitioners and researchers. However, existing FKGC methods are based on metric learning or meta-learning, which often suffer from the out-of-distribution and overfitting problems. Meanwhile, they are incompetent at estimating uncertainties in predictions, which is critically important as model predictions could be very unreliable in few-shot settings. Furthermore, most of them cannot handle complex relations and ignore path information in KGs, which largely limits their performance. In this paper, we propose a normalizing flow-based neural process for few-shot knowledge graph completion (NP-FKGC). Specifically, we unify normalizing flows and neural processes to model a complex distribution of KG completion functions. This offers a novel way to predict facts for few-shot relations while estimating the uncertainty. Then, we propose a stochastic ManifoldE decoder to incorporate the neural process and handle complex relations in few-shot settings. To further improve performance, we introduce an attentive relation path-based graph neural network to capture path information in KGs. Extensive experiments on three public datasets demonstrate that our method significantly outperforms the existing FKGC methods and achieves state-of-the-art performance. Code is available at https://github.com/RManLuo/NP-FKGC.git.

Original languageEnglish
Title of host publicationProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
EditorsMakoto P. Kato, Josiane Mothe, Barbara Poblete
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Pages900-910
Number of pages11
ISBN (Electronic)9781450394086
DOIs
Publication statusPublished - 2023
EventACM International Conference on Research and Development in Information Retrieval 2023 - Taipei, Taiwan
Duration: 23 Jul 202327 Jul 2023
Conference number: 46th
https://dl.acm.org/doi/proceedings/10.1145/3539618 (Proceedings)
https://sigir.org/sigir2023/ (Website)

Conference

ConferenceACM International Conference on Research and Development in Information Retrieval 2023
Abbreviated titleSIGIR 2023
Country/TerritoryTaiwan
CityTaipei
Period23/07/2327/07/23
Internet address

Keywords

  • Few-shot Learning
  • Knowledge Graph Completion
  • Neural Process
  • Normalizing Flow

Cite this