Adaptive Local-Component-aware Graph Convolutional Network for one-shot skeleton-based action recognition

Anqi Zhu, Qiuhong Ke, Mingming Gong, James Bailey

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

28 Citations (Scopus)

Abstract

Skeleton-based action recognition receives increasing attention because skeleton sequences reduce training complexity by eliminating visual information irrelevant to actions. To further improve sample efficiency, meta-learning-based one-shot learning solutions were developed for skeleton-based action recognition. These methods predict by finding the nearest neighbors according to the similarity between instance-level global embedding. However, such measurement holds unstable representativity due to inadequate generalized learning on the averaged local invariant and noisy features, while intuitively, steady and fine-grained recognition relies on determining key local body movements. To address this limitation, we present the Adaptive Local-Component-aware Graph Convolutional Network, which replaces the comparison metric with a focused sum of similarity measurements on aligned local embedding of action-critical spatial/temporal segments. Comprehensive one-shot experiments on the public benchmark of NTURGB+D 120 indicate that our method provides a stronger representation than the global embedding and helps our model reach state-of-the-art.
Original languageEnglish
Title of host publicationProceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023
EditorsEric Mortensen
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages6027-6036
Number of pages10
ISBN (Electronic)9781665493468
ISBN (Print)9781665493475
DOIs
Publication statusPublished - 2023
EventIEEE Winter Conference on Applications of Computer Vision 2023 - Waikoloa, United States of America
Duration: 2 Jan 20237 Jan 2023
https://ieeexplore.ieee.org/xpl/conhome/10030081/proceeding

Publication series

Name2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
PublisherIEEE, Institute of Electrical and Electronics Engineers
ISSN (Print)2472-6737
ISSN (Electronic)2642-9381

Conference

ConferenceIEEE Winter Conference on Applications of Computer Vision 2023
Abbreviated titleWACV 2023
Country/TerritoryUnited States of America
CityWaikoloa
Period2/01/237/01/23
Internet address

Keywords

  • Algorithms: Video recognition and understanding (tracking, action recognition, etc.)
  • and algorithms (including transfer, low-shot, semi-, self-, and un-supervised learning)
  • formulations
  • Machine learning architectures

Cite this