A fast and flexible computer vision system for implanted visual prostheses

Wai Ho Li

doi:10.1007/978-3-319-16199-0_48

A fast and flexible computer vision system for implanted visual prostheses

Wai Ho Li

Electrical and Computer Systems Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

7 Citations (Scopus)

Abstract

Implanted visual prostheses generate visual percepts by electrically stimulating the human visual pathway using an array of electrodes. The resulting bionic vision consists of a spatial-temporal pattern of bright dots called phosphenes. This patient-specific phosphene pattern has low resolution, limited dynamic range and is spatially irregular. This paper presents a computer vision system designed to deal with these limitations, especially spatial irregularity. The system uses a new mapping called the Camera Map to decouple the flexible spatial layout of image processing from the inflexible layout of phosphenes experienced by a patient. Detailed simulations of a cortical prosthesis currently in preclinical testing were performed to create phosphene patterns for testing. The system was tested on a wearable prototype of the cortical prosthesis. Despite having limited computational resources, the system operated in real time, taking only a few milliseconds to perform image processing and visualisations of simulated prosthetic vision.

Original language	English
Title of host publication	Computer Vision - ECCV 2014 Workshops
Subtitle of host publication	Zurich, Switzerland, September 6–7 and 12, 2014 Proceedings, Part III
Editors	Lourdes Agapito, Michael M Bronstein, Carsten Rother
Place of Publication	Cham Switzerland
Publisher	Springer
Pages	686-701
Number of pages	16
ISBN (Electronic)	9783319161990
ISBN (Print)	9783319161983
DOIs	https://doi.org/10.1007/978-3-319-16199-0_48
Publication status	Published - 2015
Event	Workshop on Assistive Computer Vision and Robotics 2014 - Zurich, Switzerland Duration: 12 Sept 2014 → 12 Sept 2014 Conference number: 2nd

Workshop

Workshop	Workshop on Assistive Computer Vision and Robotics 2014
Abbreviated title	ACVR 2014
Country/Territory	Switzerland
City	Zurich
Period	12/09/14 → 12/09/14

Keywords

Bionic eye
Camera maps
Cortical implant
Image processing
Integral images
Irregular
Phosphene maps
Real time
Simulated prosthetic vision
Visual prosthesis
Wearable computer vision

Access to Document

10.1007/978-3-319-16199-0_48

Cite this

@inproceedings{5abcfaf75bfe4628a6d6e91e4a49c95e,

title = "A fast and flexible computer vision system for implanted visual prostheses",

abstract = "Implanted visual prostheses generate visual percepts by electrically stimulating the human visual pathway using an array of electrodes. The resulting bionic vision consists of a spatial-temporal pattern of bright dots called phosphenes. This patient-specific phosphene pattern has low resolution, limited dynamic range and is spatially irregular. This paper presents a computer vision system designed to deal with these limitations, especially spatial irregularity. The system uses a new mapping called the Camera Map to decouple the flexible spatial layout of image processing from the inflexible layout of phosphenes experienced by a patient. Detailed simulations of a cortical prosthesis currently in preclinical testing were performed to create phosphene patterns for testing. The system was tested on a wearable prototype of the cortical prosthesis. Despite having limited computational resources, the system operated in real time, taking only a few milliseconds to perform image processing and visualisations of simulated prosthetic vision.",

keywords = "Bionic eye, Camera maps, Cortical implant, Image processing, Integral images, Irregular, Phosphene maps, Real time, Simulated prosthetic vision, Visual prosthesis, Wearable computer vision",

author = "Li, {Wai Ho}",

year = "2015",

doi = "10.1007/978-3-319-16199-0_48",

language = "English",

isbn = "9783319161983",

pages = "686--701",

editor = "Lourdes Agapito and Bronstein, {Michael M} and Carsten Rother",

booktitle = "Computer Vision - ECCV 2014 Workshops",

publisher = "Springer",

note = "Workshop on Assistive Computer Vision and Robotics 2014, ACVR 2014 ; Conference date: 12-09-2014 Through 12-09-2014",

}

Li, WH 2015, A fast and flexible computer vision system for implanted visual prostheses. in L Agapito, MM Bronstein & C Rother (eds), Computer Vision - ECCV 2014 Workshops: Zurich, Switzerland, September 6–7 and 12, 2014 Proceedings, Part III. Springer, Cham Switzerland, pp. 686-701, Workshop on Assistive Computer Vision and Robotics 2014, Zurich, Switzerland, 12/09/14. https://doi.org/10.1007/978-3-319-16199-0_48

A fast and flexible computer vision system for implanted visual prostheses. / Li, Wai Ho.
Computer Vision - ECCV 2014 Workshops: Zurich, Switzerland, September 6–7 and 12, 2014 Proceedings, Part III. ed. / Lourdes Agapito; Michael M Bronstein; Carsten Rother. Cham Switzerland: Springer, 2015. p. 686-701.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - A fast and flexible computer vision system for implanted visual prostheses

AU - Li, Wai Ho

N1 - Conference code: 2nd

PY - 2015

Y1 - 2015

N2 - Implanted visual prostheses generate visual percepts by electrically stimulating the human visual pathway using an array of electrodes. The resulting bionic vision consists of a spatial-temporal pattern of bright dots called phosphenes. This patient-specific phosphene pattern has low resolution, limited dynamic range and is spatially irregular. This paper presents a computer vision system designed to deal with these limitations, especially spatial irregularity. The system uses a new mapping called the Camera Map to decouple the flexible spatial layout of image processing from the inflexible layout of phosphenes experienced by a patient. Detailed simulations of a cortical prosthesis currently in preclinical testing were performed to create phosphene patterns for testing. The system was tested on a wearable prototype of the cortical prosthesis. Despite having limited computational resources, the system operated in real time, taking only a few milliseconds to perform image processing and visualisations of simulated prosthetic vision.

AB - Implanted visual prostheses generate visual percepts by electrically stimulating the human visual pathway using an array of electrodes. The resulting bionic vision consists of a spatial-temporal pattern of bright dots called phosphenes. This patient-specific phosphene pattern has low resolution, limited dynamic range and is spatially irregular. This paper presents a computer vision system designed to deal with these limitations, especially spatial irregularity. The system uses a new mapping called the Camera Map to decouple the flexible spatial layout of image processing from the inflexible layout of phosphenes experienced by a patient. Detailed simulations of a cortical prosthesis currently in preclinical testing were performed to create phosphene patterns for testing. The system was tested on a wearable prototype of the cortical prosthesis. Despite having limited computational resources, the system operated in real time, taking only a few milliseconds to perform image processing and visualisations of simulated prosthetic vision.

KW - Bionic eye

KW - Camera maps

KW - Cortical implant

KW - Image processing

KW - Integral images

KW - Irregular

KW - Phosphene maps

KW - Real time

KW - Simulated prosthetic vision

KW - Visual prosthesis

KW - Wearable computer vision

U2 - 10.1007/978-3-319-16199-0_48

DO - 10.1007/978-3-319-16199-0_48

M3 - Conference Paper

SN - 9783319161983

SP - 686

EP - 701

BT - Computer Vision - ECCV 2014 Workshops

A2 - Agapito, Lourdes

A2 - Bronstein, Michael M

A2 - Rother, Carsten

PB - Springer

CY - Cham Switzerland

T2 - Workshop on Assistive Computer Vision and Robotics 2014

Y2 - 12 September 2014 through 12 September 2014

ER -