Deep multiscale convolutional feature learning for weakly supervised localization of chest pathologies in X-ray images

Suman Sedai, Dwarikanath Mahapatra, Zongyuan Ge, Rajib Chakravorty, Rahil Garnavi

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

15 Citations (Scopus)


Localization of chest pathologies in chest X-ray images is a challenging task because of their varying sizes and appearances. We propose a novel weakly supervised method to localize chest pathologies using class aware deep multiscale feature learning. Our method leverages intermediate feature maps from CNN layers at different stages of a deep network during the training of a classification model using image level annotations of pathologies. During the training phase, a set of layer relevance weights are learned for each pathology class and the CNN is optimized to perform pathology classification by convex combination of feature maps from both shallow and deep layers using the learned weights. During the test phase, to localize the predicted pathology, the multiscale attention map is obtained by convex combination of class activation maps from each stage using the layer relevance weights learned during the training phase. We have validated our method using 112000 X-ray images and compared with the state-of-the-art localization methods. We experimentally demonstrate that the proposed weakly supervised method can improve the localization performance of small pathologies such as nodule and mass while giving comparable performance for bigger pathologies e.g., Cardiomegaly.

Original languageEnglish
Title of host publicationMachine Learning in Medical Imaging
Subtitle of host publication9th International Workshop, MLMI 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 16, 2018, Proceedings
EditorsYinghuan Shi, Heung-Il Suk, Mingxia Liu
Place of PublicationCham Switzerland
Number of pages9
ISBN (Electronic)9783030009199
ISBN (Print)9783030009182
Publication statusPublished - 1 Jan 2018
Externally publishedYes
EventInternational Workshop on Machine Learning in Medical Imaging (MLMI) 2018 - Granada Conference Centre, Granada, Spain
Duration: 16 Sept 201816 Sept 2018
Conference number: 9th (Proceedings)

Publication series

NameLecture Notes in Computer Science
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


WorkshopInternational Workshop on Machine Learning in Medical Imaging (MLMI) 2018
Abbreviated titleMLMI 2018
Internet address


  • Weakly supervised learning
  • X-ray pathology classification

Cite this