3D conditional adversarial learning for synthesizing microscopic neuron image using skeleton-to-neuron translation

Zihao Tang, Donghao Zhang, Yang Song, Heng Wang, Dongnan Liu, Chaoyi Zhang, Siqi Liu, Hanchuan Peng, Weidong Cai

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

5 Citations (Scopus)

Abstract

The automatic reconstruction of single neuron cells from microscopic images is essential to establishing the research on neuron morphology. However, the performance of single neuron reconstruction algorithms is constrained by both the quantity and the quality of the annotated 3D microscopic images since annotating large-scale single neuron models is highly labour intensive. We propose a framework for synthesizing microscopy-realistic 3D neuron images from simulated single neuron skeletons using conditional Generative Adversarial Networks (cGAN). We build the generator network with multi-resolution sub-modules to improve the output fidelity. We evaluate our framework on Janelia-Fly dataset from the BigNeuron project. With both qualitative and quantitative analysis, we show that the proposed framework outperforms the other state-of-the-art methods regarding the quality of the synthetic neuron images. We also show that combining the real neuron images and the synthetic images generated from our framework can improve the performance of neuron segmentation.

Original languageEnglish
Title of host publicationProceedings of 2020 IEEE International Symposium on Biomedical Imaging, ISBI 2020
EditorsMichael Liebling, Hayit Greenspan
Place of PublicationUSA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1775-1779
Number of pages5
Edition1st
ISBN (Electronic)9781538693308
DOIs
Publication statusPublished - Apr 2020
Externally publishedYes
EventIEEE International Symposium on Biomedical Imaging (ISBI) 2020 - Iowa City, United States of America
Duration: 3 Apr 20207 Apr 2020
Conference number: 17th
https://ieeexplore.ieee.org/xpl/conhome/9091448/proceeding (Proceedings)

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2020-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

ConferenceIEEE International Symposium on Biomedical Imaging (ISBI) 2020
Abbreviated titleISBI 2020
Country/TerritoryUnited States of America
CityIowa City
Period3/04/207/04/20
Internet address

Keywords

  • Data Augmentation
  • Image Synthesis
  • Neuron Image

Cite this