A unified framework for static and dynamic functional connectivity augmentation for multi-domain brain disorder classification

Yee-Fan Tan, Chee Ming Ting, Fuad Noman, Raphaël C.W. Phan, Hernando Ombao

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Deep learning (DL) methods recently show promise on accurate brain disorder classification using functional connectivity (FC) estimated from functional magnetic resonance imaging (fMRI). However, DL model building can be hindered by small sample-size settings of fMRI. Moreover, most studies utilize either static (sFC) or dynamic FC (dFC) for classification. We propose a unified framework for data augmentation of both sFC and dFC for multi-domain joint classification of brain disorders. We exploit generative adversarial networks (GAN) to synthesize realistic FCs for data augmentation. Notably, we adopted the TimeGAN for dFC generation that can capture temporal dependencies in real dFC, and the GR-SPD-GAN for sFC generation that preserves the spatial connectivity structure. We further develop BrainFusionNet - a specialized DL model for multi-domain FC that simultaneously learns embedded features from both sFC and dFC to provide complementary spatio-temporal information for downstream classification. The synthetic FC data are augmented in training data to improve the BrainFusionNet performance and generalizability. Experimental results on major depressive disorder (MDD) identification using resting-state fMRI show substantial improvement in classification accuracy by our framework, outperforming competing models without FC augmentation and using sFC or dFC features alone.

Original languageEnglish
Title of host publication2023 IEEE International Conference on Image Processing, Proceedings
EditorsChong-Wah Ngo, John See
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages635-639
Number of pages5
ISBN (Electronic)9781728198354
ISBN (Print)9781728198361
DOIs
Publication statusPublished - 2023
EventIEEE International Conference on Image Processing 2023 - Kuala Lumpur, Malaysia
Duration: 8 Oct 202311 Oct 2023
Conference number: 30th
https://ieeexplore.ieee.org/xpl/conhome/10221937/proceeding (Proceedings)
https://2023.ieeeicip.org (Website)

Publication series

NameProceedings - International Conference on Image Processing, ICIP
PublisherIEEE, Institute of Electrical and Electronics Engineers
ISSN (Print)1522-4880

Conference

ConferenceIEEE International Conference on Image Processing 2023
Abbreviated titleICIP 2023
Country/TerritoryMalaysia
CityKuala Lumpur
Period8/10/2311/10/23
Internet address

Keywords

  • Brain functional connectivity
  • data augmentation
  • generative adversarial networks
  • rs-fMRI

Cite this