Extending egocentric vision into vehicles: Malaysian dash-cam dataset

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Egocentric Vision (EV) has recently become one of the emerging areas in computer vision. It is a process of recording a person’s activity by using a wearable camera installed on the head of that person to gain an exclusive viewpoint. This field has gained more attention recently due to the wide availability of wearable cameras commercially and the recent success of Deep Learning (DL). Such attention has resulted in publishing more EV datasets. In this paper, we argue that the concept of egocentric vision is similar to the recording of road activities by a portable camera installed on the dashboard of a vehicle (commonly known as DashCam) to gain an exclusive viewpoint. We attempt to extend the EV concept into vehicles and show how the two viewpoints are similar. To support this argument, we collect and annotate the first Malaysian DashCam dataset, which consists of 228 video clips about road activities classified into ten categories. We use this dataset to train a DL model on top of VGG16 model -a DL model that is pre-trained on ImageNet-, to perform an initial experiment (activity classification), which reveals some limitations of this work such as small dataset size and less distribution of examples among categories. From this work, we learn that such a dataset may lead to the discovery of valuable statistical knowledge about most frequently occurring behaviors that cause accidents and that we may leverage DL to understand such behaviors to save human life.

Original languageEnglish
Title of host publicationIntelligent Robotics and Applications
Subtitle of host publication13th International Conference, ICIRA 2020, Proceedings
EditorsChee Seng Chan, Hong Liu, Xiangyang Zhu, Chern Hong Lim, Xinjun Liu, Lianqing Liu, Kam Meng Goh
Place of PublicationCham Switzerland
PublisherSpringer
Pages270-281
Number of pages12
ISBN (Electronic)9783030666453
ISBN (Print)9783030666446
DOIs
Publication statusPublished - 2020
EventInternational Conference on Intelligent Robotics and Applications 2020 - Kuala Lumpur, Malaysia
Duration: 5 Nov 20207 Nov 2020
Conference number: 13th
https://link.springer.com/book/10.1007/978-3-030-66645-3 (Proceedings)

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume12595
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceInternational Conference on Intelligent Robotics and Applications 2020
Abbreviated titleICIRA 2020
Country/TerritoryMalaysia
CityKuala Lumpur
Period5/11/207/11/20
Internet address

Keywords

  • Action recognition
  • Activity recognition
  • Computer vision
  • DashCam
  • Dashcam vision
  • Deep learning
  • Egocentric vision

Cite this