Searching persuasively: joint event detection and evidence recounting with limited supervision

Xiaojun Chang, Yao-Liang Yu, Yi Yang, Alexander G. Hauptmann

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

34 Citations (Scopus)


Multimedia event detection (MED) and multimedia event recounting (MER) are fundamental tasks in managing large amounts of unconstrained web videos, and have attracted a lot of attention in recent years. Most existing systems perform MER as a postprocessing step on top of the MED results. In order to leverage the mutual benefits of the two tasks, we propose a joint framework that simultaneously detects high-level events and localizes the indicative concepts of the events. Our premise is that a good recounting algorithm should not only explain the detection result, but should also be able to assist detection in the first place. Coupled in a joint optimization framework, recounting improves detection by pruning irrelevant noisy concepts while detection directs recounting to the most discriminative evidences. To better utilize the powerful and interpretable semantic video representation, we segment each video into several shots and exploit the rich temporal structures at shot level. The consequent computational challenge is carefully addressed through a significant improvement of the current ADMM algorithm, which, after eliminating all inner loops and equipping novel closed-form solutions for all intermediate steps, enables us to efficiently process extremely large video corpora. We test the proposed method on the large scale TRECVID MEDTest 2014 and MEDTest 2013 datasets, and obtain very promising results for both MED and MER.

Original languageEnglish
Title of host publicationMM’15 Proceedings of the 2015 ACM Multimedia Conference
Subtitle of host publicationOctober 26-30, 2015 Brisbane, Australia
EditorsDick C.A. Bulterman, Heng Tao Shen, Ketan Mayer-Patel, Shuicheng Yan
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages10
ISBN (Electronic)9781450334594
Publication statusPublished - 2015
Externally publishedYes
EventACM International Conference on Multimedia 2015 - Brisbane, Australia
Duration: 26 Oct 201530 Oct 2015
Conference number: 23rd


ConferenceACM International Conference on Multimedia 2015
Abbreviated titleMM 2015
Internet address


  • Multimedia Event Detection
  • Multimedia Event Recounting
  • Video Analysis

Cite this