Multi-scale contrastive siamese networks for self-supervised graph representation learning

Ming Jin, Yizhen Zheng, Yuan-Fang Li, Chen Gong, Chuan Zhou, Shirui Pan

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of graph contrastive learning and Siamese networks in visual representation learning, we propose a novel self-supervised approach in this paper to learn node representations by enhancing Siamese self-distillation with multi-scale contrastive learning. Specifically, we first generate two augmented views from the input graph based on local and global perspectives. Then, we employ two objectives called cross-view and cross-network contrastiveness to maximize the agreement between node representations across different views and networks. To demonstrate the effectiveness of our approach, we perform empirical experiments on five real-world datasets. Our method not only achieves new state-of-the-art results but also surpasses some semi-supervised counterparts by large margins. Code is made available at https://github.com/GRAND-Lab/MERIT
Original languageEnglish
Title of host publicationProceedings of the Thirtieth International Joint Conference on Artificial Intelligence
EditorsZhi-Hua Zhou
Place of PublicationMarina del Rey CA USA
PublisherAssociation for the Advancement of Artificial Intelligence (AAAI)
Pages1477-1483
Number of pages7
ISBN (Electronic)9780999241196
Publication statusPublished - 2021
EventInternational Joint Conference on Artificial Intelligence 2021 - Virtual, Montreal, Canada
Duration: 19 Aug 202127 Aug 2021
Conference number: 30th
https://www.ijcai.org/proceedings/2021/ (Proceedings)
https://ijcai-21.org (Website)

Conference

ConferenceInternational Joint Conference on Artificial Intelligence 2021
Abbreviated titleIJCAI 2021
CountryCanada
CityMontreal
Period19/08/2127/08/21
Internet address

Keywords

  • Data Mining
  • Mining Graphs
  • Semi Structured Data
  • Complex Data
  • Machine Learning
  • Unsupervised Learning

Cite this