Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain

Larissa Heinrich, Jan Funke, Constantin Pape, Juan Nunez-Iglesias, Stephan Saalfeld

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

5 Citations (Scopus)

Abstract

Neural circuit reconstruction at single synapse resolution is increasingly recognized as crucially important to decipher the function of biological nervous systems. Volume electron microscopy in serial transmission or scanning mode has been demonstrated to provide the necessary resolution to segment or trace all neurites and to annotate all synaptic connections. Automatic annotation of synaptic connections has been done successfully in near isotropic electron microscopy of vertebrate model organisms. Results on non-isotropic data in insect models, however, are not yet on par with human annotation. We designed a new 3D-U-Net architecture to optimally represent isotropic fields of view in non-isotropic data. We used regression on a signed distance transform of manually annotated synaptic clefts of the CREMI challenge dataset to train this model and observed significant improvement over the state of the art. We developed open source software for optimized parallel prediction on very large volumetric datasets and applied our model to predict synaptic clefts in a 50 tera-voxels dataset of the complete Drosophila brain. Our model generalizes well to areas far away from where training data was available.

Original languageEnglish
Title of host publicationProceedings of Medical Image Computing and Computer Assisted Intervention - MICCAI 2018
EditorsAlejandro F. Frangi, Julia A. Schnabel, Christos Davatzikos, Carlos Alberola-Lopez, Gabor Fichtinger
Place of PublicationSwitzerland
PublisherSpringer
Pages317-325
Number of pages9
ISBN (Electronic)9783030009342
ISBN (Print)9783030009335
DOIs
Publication statusPublished - 20 Sep 2018
Externally publishedYes
EventMedical Image Computing and Computer-Assisted Intervention 2018 - Granada, Spain
Duration: 16 Sep 201820 Sep 2018
Conference number: 21st
https://www.miccai2018.org/en/

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11071 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceMedical Image Computing and Computer-Assisted Intervention 2018
Abbreviated titleMICCAI 2018
CountrySpain
CityGranada
Period16/09/1820/09/18
Internet address

Cite this

Heinrich, L., Funke, J., Pape, C., Nunez-Iglesias, J., & Saalfeld, S. (2018). Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain. In A. F. Frangi, J. A. Schnabel, C. Davatzikos, C. Alberola-Lopez, & G. Fichtinger (Eds.), Proceedings of Medical Image Computing and Computer Assisted Intervention - MICCAI 2018 (pp. 317-325). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11071 LNCS). Switzerland: Springer. https://doi.org/10.1007/978-3-030-00934-2_36
Heinrich, Larissa ; Funke, Jan ; Pape, Constantin ; Nunez-Iglesias, Juan ; Saalfeld, Stephan. / Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain. Proceedings of Medical Image Computing and Computer Assisted Intervention - MICCAI 2018. editor / Alejandro F. Frangi ; Julia A. Schnabel ; Christos Davatzikos ; Carlos Alberola-Lopez ; Gabor Fichtinger. Switzerland : Springer, 2018. pp. 317-325 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{71b3579f22ce435faaf467b425fba0bb,
title = "Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain",
abstract = "Neural circuit reconstruction at single synapse resolution is increasingly recognized as crucially important to decipher the function of biological nervous systems. Volume electron microscopy in serial transmission or scanning mode has been demonstrated to provide the necessary resolution to segment or trace all neurites and to annotate all synaptic connections. Automatic annotation of synaptic connections has been done successfully in near isotropic electron microscopy of vertebrate model organisms. Results on non-isotropic data in insect models, however, are not yet on par with human annotation. We designed a new 3D-U-Net architecture to optimally represent isotropic fields of view in non-isotropic data. We used regression on a signed distance transform of manually annotated synaptic clefts of the CREMI challenge dataset to train this model and observed significant improvement over the state of the art. We developed open source software for optimized parallel prediction on very large volumetric datasets and applied our model to predict synaptic clefts in a 50 tera-voxels dataset of the complete Drosophila brain. Our model generalizes well to areas far away from where training data was available.",
author = "Larissa Heinrich and Jan Funke and Constantin Pape and Juan Nunez-Iglesias and Stephan Saalfeld",
year = "2018",
month = "9",
day = "20",
doi = "10.1007/978-3-030-00934-2_36",
language = "English",
isbn = "9783030009335",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer",
pages = "317--325",
editor = "Frangi, {Alejandro F.} and Schnabel, {Julia A.} and Christos Davatzikos and Carlos Alberola-Lopez and Gabor Fichtinger",
booktitle = "Proceedings of Medical Image Computing and Computer Assisted Intervention - MICCAI 2018",

}

Heinrich, L, Funke, J, Pape, C, Nunez-Iglesias, J & Saalfeld, S 2018, Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain. in AF Frangi, JA Schnabel, C Davatzikos, C Alberola-Lopez & G Fichtinger (eds), Proceedings of Medical Image Computing and Computer Assisted Intervention - MICCAI 2018. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11071 LNCS, Springer, Switzerland, pp. 317-325, Medical Image Computing and Computer-Assisted Intervention 2018, Granada, Spain, 16/09/18. https://doi.org/10.1007/978-3-030-00934-2_36

Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain. / Heinrich, Larissa; Funke, Jan; Pape, Constantin; Nunez-Iglesias, Juan; Saalfeld, Stephan.

Proceedings of Medical Image Computing and Computer Assisted Intervention - MICCAI 2018. ed. / Alejandro F. Frangi; Julia A. Schnabel; Christos Davatzikos; Carlos Alberola-Lopez; Gabor Fichtinger. Switzerland : Springer, 2018. p. 317-325 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11071 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

TY - GEN

T1 - Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain

AU - Heinrich, Larissa

AU - Funke, Jan

AU - Pape, Constantin

AU - Nunez-Iglesias, Juan

AU - Saalfeld, Stephan

PY - 2018/9/20

Y1 - 2018/9/20

N2 - Neural circuit reconstruction at single synapse resolution is increasingly recognized as crucially important to decipher the function of biological nervous systems. Volume electron microscopy in serial transmission or scanning mode has been demonstrated to provide the necessary resolution to segment or trace all neurites and to annotate all synaptic connections. Automatic annotation of synaptic connections has been done successfully in near isotropic electron microscopy of vertebrate model organisms. Results on non-isotropic data in insect models, however, are not yet on par with human annotation. We designed a new 3D-U-Net architecture to optimally represent isotropic fields of view in non-isotropic data. We used regression on a signed distance transform of manually annotated synaptic clefts of the CREMI challenge dataset to train this model and observed significant improvement over the state of the art. We developed open source software for optimized parallel prediction on very large volumetric datasets and applied our model to predict synaptic clefts in a 50 tera-voxels dataset of the complete Drosophila brain. Our model generalizes well to areas far away from where training data was available.

AB - Neural circuit reconstruction at single synapse resolution is increasingly recognized as crucially important to decipher the function of biological nervous systems. Volume electron microscopy in serial transmission or scanning mode has been demonstrated to provide the necessary resolution to segment or trace all neurites and to annotate all synaptic connections. Automatic annotation of synaptic connections has been done successfully in near isotropic electron microscopy of vertebrate model organisms. Results on non-isotropic data in insect models, however, are not yet on par with human annotation. We designed a new 3D-U-Net architecture to optimally represent isotropic fields of view in non-isotropic data. We used regression on a signed distance transform of manually annotated synaptic clefts of the CREMI challenge dataset to train this model and observed significant improvement over the state of the art. We developed open source software for optimized parallel prediction on very large volumetric datasets and applied our model to predict synaptic clefts in a 50 tera-voxels dataset of the complete Drosophila brain. Our model generalizes well to areas far away from where training data was available.

UR - http://www.scopus.com/inward/record.url?scp=85054065238&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-00934-2_36

DO - 10.1007/978-3-030-00934-2_36

M3 - Conference Paper

SN - 9783030009335

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 317

EP - 325

BT - Proceedings of Medical Image Computing and Computer Assisted Intervention - MICCAI 2018

A2 - Frangi, Alejandro F.

A2 - Schnabel, Julia A.

A2 - Davatzikos, Christos

A2 - Alberola-Lopez, Carlos

A2 - Fichtinger, Gabor

PB - Springer

CY - Switzerland

ER -

Heinrich L, Funke J, Pape C, Nunez-Iglesias J, Saalfeld S. Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain. In Frangi AF, Schnabel JA, Davatzikos C, Alberola-Lopez C, Fichtinger G, editors, Proceedings of Medical Image Computing and Computer Assisted Intervention - MICCAI 2018. Switzerland: Springer. 2018. p. 317-325. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-00934-2_36