Beyond smoothing: Unsupervised graph representation learning with edge heterophily discriminating

Yixin Liu, Yizhen Zheng, Daokun Zhang, Vincent CS Lee, Shirui Pan

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

9 Citations (Scopus)

Abstract

Unsupervised graph representation learning (UGRL) has
drawn increasing research attention and achieved promising
results in several graph analytic tasks. Relying on the homophily assumption, existing UGRL methods tend to smooth
the learned node representations along all edges, ignoring
the existence of heterophilic edges that connect nodes with
distinct attributes. As a result, current methods are hard
to generalize to heterophilic graphs where dissimilar nodes
are widely connected, and also vulnerable to adversarial attacks. To address this issue, we propose a novel unsupervised Graph Representation learning method with Edge
hEterophily discriminaTing (GREET) which learns representations by discriminating and leveraging homophilic edges
and heterophilic edges. To distinguish two types of edges,
we build an edge discriminator that infers edge homophily/heterophily from feature and structure information. We
train the edge discriminator in an unsupervised way through
minimizing the crafted pivot-anchored ranking loss, with randomly sampled node pairs acting as pivots. Node representations are learned through contrasting the dual-channel
encodings obtained from the discriminated homophilic and
heterophilic edges. With an effective interplaying scheme,
edge discriminating and representation learning can mutually
boost each other during the training phase. We conducted extensive experiments on 14 benchmark datasets and multiple
learning scenarios to demonstrate the superiority of GREET
Original languageEnglish
Title of host publicationProceedings of the 37th AAAI Conference on Artificial Intelligence
EditorsBrian Williams, Yiling Chen, Jennifer Neville
Place of PublicationWashington DC USA
PublisherAssociation for the Advancement of Artificial Intelligence (AAAI)
Pages4516-4524
Number of pages9
ISBN (Electronic)9781577358800
DOIs
Publication statusPublished - 2023
EventAAAI Conference on Artificial Intelligence 2023 - Washington, United States of America
Duration: 7 Feb 202314 Feb 2023
Conference number: 37th
https://aaai-23.aaai.org
https://ojs.aaai.org/index.php/AAAI/index (Proceedings)

Publication series

NameProceedings of the AAAI Conference on Artificial Intelligence
PublisherAAAI Press
Number4
Volume37
ISSN (Print)2159-5399
ISSN (Electronic)2374-3468

Conference

ConferenceAAAI Conference on Artificial Intelligence 2023
Abbreviated titleAAAI 2023
Country/TerritoryUnited States of America
CityWashington
Period7/02/2314/02/23
Internet address

Keywords

  • DMKM
  • Graph Mining
  • Social Network Analysis & Community Mining
  • Linked Open Data
  • Knowledge Graphs & KB Completion
  • Graph-based Machine Learning
  • ML

Cite this