Incremental multimodal query construction for video search

Shicheng Xu, Huan Li, Xiaojun Chang, Shoou-I Yu, Xingzhong Du, Xuanchong Li, Lu Jiang, Zexi Mao, Zhenzhong Lan, Susanne Burger, Alexander Hauptmann

Research output: Chapter in Book/Report/Conference proceedingConference PaperOther

13 Citations (Scopus)

Abstract

Recent improvements in content-based video search have led to systems with promising accuracy, thus opening up the possibility for interactive content-based video search to the general public. We present an interactive system based on a state-of-the-art content-based video search pipeline which enables users to do multimodal text-to-video and video-tovideo search in large video collections, and to incrementally refine queries through relevance feedback and model visualization. Also, the comprehensive functionalities enhance a flexible formulation of multimodal queries with different characteristics. Quantitative and qualitative analysis shows that our system is capable of assisting users to incrementally build effective queries over complex event topics.

Original languageEnglish
Title of host publicationICMR’15 - Proceedings of the 2015 ACM International Conference on Multimedia Retrieval
Subtitle of host publicationJune 23–26, 2015 Shanghai, China
EditorsYu-Gang Jiang, Cees Snoek, Nuno Vasconcelos
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Pages675-678
Number of pages4
ISBN (Electronic)9781450332743
DOIs
Publication statusPublished - 2015
Externally publishedYes
EventACM International Conference on Multimedia Retrieval 2015 - Shanghai, China
Duration: 23 Jun 201526 Jun 2015
Conference number: 5th
https://dl.acm.org/doi/proceedings/10.1145/2671188 (Proceedings)

Conference

ConferenceACM International Conference on Multimedia Retrieval 2015
Abbreviated titleICMR 2015
CountryChina
CityShanghai
Period23/06/1526/06/15
Internet address

Keywords

  • Content-based video search
  • Multimedia event detection
  • Multimodal query generation

Cite this

Xu, S., Li, H., Chang, X., Yu, S-I., Du, X., Li, X., Jiang, L., Mao, Z., Lan, Z., Burger, S., & Hauptmann, A. (2015). Incremental multimodal query construction for video search. In Y-G. Jiang, C. Snoek, & N. Vasconcelos (Eds.), ICMR’15 - Proceedings of the 2015 ACM International Conference on Multimedia Retrieval: June 23–26, 2015 Shanghai, China (pp. 675-678). Association for Computing Machinery (ACM). https://doi.org/10.1145/2671188.2749413