Abstract
Skin cancer is the most common cancer world-wide, among which Melanoma the most fatal cancer, accounts for more than 10,000 deaths annually in Australia and United States. The 5-year survival rate for Melanoma can be increased over 90% if detected in its early stage. However, intrinsic visual similarity across various skin conditions makes the diagnosis challenging both for clinicians and automated classification methods. Many automated skin cancer diagnostic systems have been proposed in literature, all of which consider solely dermoscopy images in their analysis. In reality, however, clinicians consider two modalities of imaging; an initial screening using clinical photography images to capture a macro view of the mole, followed by dermoscopy imaging which visualizes morphological structures within the skin lesion. Evidences show that these two modalities provide complementary visual features that can empower the decision making process. In this work, we propose a novel deep convolutional neural network (DCNN) architecture along with a saliency feature descriptor to capture discriminative features of the two modalities for skin lesions classification. The proposed DCNN accepts a pair images of clinical and dermoscopic view of a single lesion and is capable of learning single-modality and cross-modality representations, simultaneously. Using one of the largest collected skin lesion datasets, we demonstrate that the proposed multi-modality method significantly outperforms single-modality methods on three tasks; differentiation between 15 various skin diseases, distinguishing cancerous (3 cancer types including melanoma) from non-cancerous moles, and detecting melanoma from benign cases.
Original language | English |
---|---|
Title of host publication | Medical Image Computing and Computer Assisted Intervention − MICCAI 2017 |
Subtitle of host publication | 20th International Conference, Quebec City, QC, Canada, September 11–13, 2017 Proceedings, Part III |
Editors | Maxime Descoteaux, Lena Maier-Hein, Alfred Franz, D. Louis Collins, Simon Duchesne |
Place of Publication | Cham Switzerland |
Publisher | Springer |
Pages | 250-258 |
Number of pages | 9 |
ISBN (Electronic) | 9783319661797 |
ISBN (Print) | 9783319661780 |
DOIs | |
Publication status | Published - 1 Jan 2017 |
Externally published | Yes |
Event | Medical Image Computing and Computer-Assisted Intervention 2017 - Quebec City Convention Centre, Quebec City, Canada Duration: 11 Sept 2017 → 13 Sept 2017 Conference number: 20th http://www.miccai2017.org/ https://link.springer.com/book/10.1007/978-3-319-66182-7 (Proceedings) |
Publication series
Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Publisher | Springer |
Volume | 10435 LNCS |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | Medical Image Computing and Computer-Assisted Intervention 2017 |
---|---|
Abbreviated title | MICCAI 2017 |
Country/Territory | Canada |
City | Quebec City |
Period | 11/09/17 → 13/09/17 |
Internet address |