Cross-modal transfer hashing based on coherent projection

En Yu, Jiande Sun, Li Wang, Xiaojun Chang, Huaxiang Zhang, Alexander G. Hauptmann

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearch

Abstract

Due to the low storage and high efficiency, cross-modal hashing drew more and more attention in recent years. However, most existing methods ignore the intrinsic distribution of raw features and the inheritance relationship between raw feature space and hash space. In this paper, we propose the transfer hashing based on coherent projection for large-scale cross-modal retrieval. It preserves the inherent correlation of intrinsic distribution among raw heterogeneous features via a linear cross-modal transfer. In addition, the coherent projection is applied to cooperate with the cross-modal transfer to inherit the correlation from raw features space to hash space straightly. Furthermore, the anchor graph with linear complexity is utilized to further explore the local structure of each modality. And the semantic information is also explored by regressing the semantic labels to hash space. Finally, the succinct iterative algorithm is used for discrete optimization, which avoids continuous relaxation and reduces quantization error. Extensive experiments on two large-scale datasets show that our method has superiority in retrieval performance.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2019
EditorsMarta Mrak, Jun Wu, Honggang Wang, Roger Zimmermann, Zhu Li, Lei Zhang
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages477-482
Number of pages6
ISBN (Electronic)9781538692141, 9781538692134
ISBN (Print)9781538692158
DOIs
Publication statusPublished - 2019
EventIEEE International Conference on Multimedia and Expo Workshops 2019 - Shanghai, China
Duration: 8 Jul 201912 Jul 2019
https://www.icme2019.org/

Conference

ConferenceIEEE International Conference on Multimedia and Expo Workshops 2019
Abbreviated titleICMEW 2019
CountryChina
CityShanghai
Period8/07/1912/07/19
Internet address

Keywords

  • Coherent projection
  • Cross-modal retrieval
  • Cross-modal transfer
  • Structured constraint

Cite this

Yu, E., Sun, J., Wang, L., Chang, X., Zhang, H., & Hauptmann, A. G. (2019). Cross-modal transfer hashing based on coherent projection. In M. Mrak, J. Wu, H. Wang, R. Zimmermann, Z. Li, & L. Zhang (Eds.), Proceedings - 2019 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2019 (pp. 477-482). [8794952] IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICMEW.2019.00088