Joint registration and segmentation of xray images using generative adversarial networks

Dwarikanath Mahapatra, Zongyuan Ge, Suman Sedai, Rajib Chakravorty

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

8 Citations (Scopus)

Abstract

Medical image registration and segmentation are complementary functions and combining them can improve each other’s performance. Conventional deep learning (DL) based approaches tackle the two problems separately without leveraging their mutually beneficial information. We propose a DL based approach for joint registration and segmentation (JRS) of chest Xray images. Generative adversarial networks (GANs) are trained to register a floating image to a reference image by combining their segmentation map similarity with conventional feature maps. Intermediate segmentation maps from the GAN’s convolution layers are used in the training stage to generate the final segmentation mask at test time. Experiments on chest Xray images show that JRS gives better registration and segmentation performance than when solving them separately.

Original languageEnglish
Title of host publicationMachine Learning in Medical Imaging
Subtitle of host publication9th International Workshop, MLMI 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 16, 2018, Proceedings
EditorsYinghuan Shi, Heung-Il Suk, Mingxia Liu
Place of PublicationCham Switzerland
PublisherSpringer
Pages73-80
Number of pages8
Volume11046
ISBN (Electronic)9783030009199
ISBN (Print)9783030009182
DOIs
Publication statusPublished - 1 Jan 2018
EventInternational Workshop on Machine Learning in Medical Imaging (MLMI) 2018 - Granada Conference Centre, Granada, Spain
Duration: 16 Sep 201816 Sep 2018
Conference number: 9th
http://mlmi2018.web.unc.edu/

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume11046
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceInternational Workshop on Machine Learning in Medical Imaging (MLMI) 2018
Abbreviated titleMLMI 2018
CountrySpain
CityGranada
Period16/09/1816/09/18
Internet address

Cite this

Mahapatra, D., Ge, Z., Sedai, S., & Chakravorty, R. (2018). Joint registration and segmentation of xray images using generative adversarial networks. In Y. Shi, H-I. Suk, & M. Liu (Eds.), Machine Learning in Medical Imaging: 9th International Workshop, MLMI 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 16, 2018, Proceedings (Vol. 11046, pp. 73-80). (Lecture Notes in Computer Science ; Vol. 11046). Springer. https://doi.org/10.1007/978-3-030-00919-9_9