Adaptive Semi-supervised Feature Selection for cross-modal retrieval

En Yu, Jiande Sun, Jing Li, Xiaojun Chang, Xian-Hua Han, Alexander G. Hauptmann

Research output: Contribution to journalArticleResearchpeer-review

51 Citations (Scopus)


In order to exploit the abundant potential information of the unlabeled data and contribute to analyze the correlation among heterogeneous data, we propose the semi-supervised model named Adaptive Semi-supervised Feature Selection (ASFS) for cross-modal retrieval. Firstly, we utilize the semantic regression to strengthen the neighbor relationship between the data with the same semantic. And the correlation between heterogeneous data can be optimized via keeping the pairwise closeness when learning the common latent space. Secondly, we adopt the graph-based constraint to predict accurate labels for unlabeled data, and it can also keep the geometric structure consistency between the label space and feature space of heterogeneous data in the common latent space. Finally, an efficient joint optimization algorithm is proposed to update the mapping matrices and label matrix for unlabeled data simultaneously and iteratively. It makes samples from different classes to be far apart while the samples from same class lie as close as possible. Meanwhile, the <formula><tex>${l_{2,1}}$</tex></formula>-norm constraint is used for feature selection and outliers reduction when the mapping matrices are learned. In addition, we propose learning different mapping matrices corresponding to different sub-tasks to emphasize the semantic and structural information of query data. Experiment results on three datasets demonstrate that our method performs better than the state-of-the-art methods.

Original languageEnglish
Pages (from-to)1276-1288
Number of pages13
JournalIEEE Transactions on Multimedia
Issue number5
Publication statusPublished - May 2019


  • Bicycles
  • Correlation
  • cross-modal retrieval
  • Feature extraction
  • feature selection
  • Learning systems
  • Optimization
  • Semantics
  • semi-supervised
  • Task analysis

Cite this