Improve Unseen Domain Generalization via Enhanced Local Color Transformation

Jianhao Xiong, Andre Wang He, Meng Fu, Xinyue Hu, Yifan Zhang, Congxin Liu, Xin Zhao, Zongyuan Ge

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review


Recent application of deep learning in medical image achieves expert-level accuracy. However, the accuracy often degrades greatly on unseen data, for example data from different device designs and population distributions. In this work, we consider a realistic problem of domain generalization in fundus image analysis: when a model is trained on a certain domain but tested on unseen domains. Here, the known domain data is taken from a single fundus camera manufacture, i.e. Canon. The unseen data are the image from different demographic population and with distinct photography styles. Specifically, the unseen images are taken from Topcom, Syseye and Crystalvue cameras. The model performance is evaluated by two objectives: age regression and diabetic retinopathy (DR) classification. We found that the model performance on unseen domain could decrease significantly. For example, the mean absolute error (MAE) of age prediction could increase by 57.7 %. To remedy this problem, we introduce an easy-to-use method, named enhanced domain transformation (EDT), to improve the performance on both seen and unseen data. The goal of EDT is to achieve domain adaptation without using labeling and training on unseen images. We evaluate our method comprehensively on seen and unseen data sets considering the factors of demographic distribution, image style and prediction task. All the results demonstrate that EDT improves the performance on seen and unseen data in the tasks of age prediction and DR classification. Equipped with EDT, the (coefficient of determination) of age prediction could be greatly improved from 0.599 to 0.765 (n = 29,577) on Crystalvue images, and AUC (area under curve) of DR classification increases from 0.875 to 0.922 (n = 1,015).

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention – MICCAI 2020
Subtitle of host publication23rd International Conference, Proceedings, Part II
EditorsAnne L. Martel, Purang Abolmaesumi, Danail Stoyanov, Diana Mateus, Maria A. Zuluaga, S. Kevin Zhou, Daniel Racoceanu, Leo Joskowicz
Place of PublicationCham Sqitzerland
Number of pages11
ISBN (Electronic)9783030597139
ISBN (Print)9783030597122
Publication statusPublished - 2020
EventMedical Image Computing and Computer-Assisted Intervention 2020 - Virtual, Online, Lima, Peru
Duration: 4 Oct 20208 Oct 2020
Conference number: 23rd (Proceedings)

Publication series

NameLecture Notes in Computer Science
Volume12262 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


ConferenceMedical Image Computing and Computer-Assisted Intervention 2020
Abbreviated titleMICCAI 2020
Internet address


  • Deep learning
  • Fundus image
  • Unseen domain

Cite this