Future Moment assessment for action query

Qiuhong Ke, Mario Fritz, Bernt Schiele

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

2 Citations (Scopus)

Abstract

In this paper, we aim to tackle the task of Assessing Future Moment of an Action of Interest (AFM-AI). The goal of this task is to assess if an action of interest will happen or not as well as the starting moment of the action. We aim to assess starting moments at any time-horizon of the future. To this end, we tackle the regression task of the starting moments as a generation task using a Deterministic Residual Guided Variational Regression Module (DR-VRM), which is built on a Variational Regression Module (VRM) and a deterministic residual network. The VRM takes the uncertainty into account and is capable of generating diverse predictions for the starting moment. The deterministic network encourages the VRM to learn from deterministic residual information in order to generate more precise predictions for moment assessment. Experimental results on three datasets clearly show that the proposed method is capable of generating both diverse and precise predictions of starting moments for query actions.

Original languageEnglish
Title of host publicationProceedings - 2021 IEEE Winter Conference on Applications of Computer Vision, WACV 2021
EditorsCristian Canton, Laura Leal-Taixe
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages3218-3227
Number of pages10
ISBN (Electronic)9780738142661, 9781665404778
ISBN (Print)9781665446402
DOIs
Publication statusPublished - 2021
Externally publishedYes
EventIEEE Winter Conference on Applications of Computer Vision 2021 - Online, United States of America
Duration: 4 Jan 20228 Jan 2022
https://wacv2022.thecvf.com/home (Website)
https://ieeexplore.ieee.org/xpl/conhome/9706406/proceeding (Proceedings)

Publication series

NameProceedings - 2021 IEEE Winter Conference on Applications of Computer Vision, WACV 2021
PublisherIEEE, Institute of Electrical and Electronics Engineers
ISSN (Print)2472-6737
ISSN (Electronic)2642-9381

Conference

ConferenceIEEE Winter Conference on Applications of Computer Vision 2021
Abbreviated titleWACV 2021
Country/TerritoryUnited States of America
Period4/01/228/01/22
Internet address

Cite this