A fast and flexible computer vision system for implanted visual prostheses

Wai Ho Li

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

5 Citations (Scopus)

Abstract

Implanted visual prostheses generate visual percepts by electrically stimulating the human visual pathway using an array of electrodes. The resulting bionic vision consists of a spatial-temporal pattern of bright dots called phosphenes. This patient-specific phosphene pattern has low resolution, limited dynamic range and is spatially irregular. This paper presents a computer vision system designed to deal with these limitations, especially spatial irregularity. The system uses a new mapping called the Camera Map to decouple the flexible spatial layout of image processing from the inflexible layout of phosphenes experienced by a patient. Detailed simulations of a cortical prosthesis currently in preclinical testing were performed to create phosphene patterns for testing. The system was tested on a wearable prototype of the cortical prosthesis. Despite having limited computational resources, the system operated in real time, taking only a few milliseconds to perform image processing and visualisations of simulated prosthetic vision.
Original languageEnglish
Title of host publicationComputer Vision - ECCV 2014 Workshops
Subtitle of host publicationZurich, Switzerland, September 6–7 and 12, 2014 Proceedings, Part III
EditorsLourdes Agapito, Michael M Bronstein, Carsten Rother
Place of PublicationCham Switzerland
PublisherSpringer
Pages686-701
Number of pages16
ISBN (Electronic)9783319161990
ISBN (Print)9783319161983
DOIs
Publication statusPublished - 2015
EventWorkshop on Assistive Computer Vision and Robotics 2014 - Zurich, Switzerland
Duration: 12 Sep 201412 Sep 2014
Conference number: 2nd

Workshop

WorkshopWorkshop on Assistive Computer Vision and Robotics 2014
Abbreviated titleACVR 2014
CountrySwitzerland
CityZurich
Period12/09/1412/09/14

Keywords

  • Bionic eye
  • Camera maps
  • Cortical implant
  • Image processing
  • Integral images
  • Irregular
  • Phosphene maps
  • Real time
  • Simulated prosthetic vision
  • Visual prosthesis
  • Wearable computer vision

Cite this