Texture semantically aligned with visibility-aware for partial person re-identification

Lishuai Gao, Hua Zhang, Zan Gao, Weili Guan, Zhiyong Cheng, Meng Wang

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearch

17 Citations (Scopus)

Abstract

In real person re-identification (ReID) tasks, pedestrians are often obscured by other pedestrians or objects; moreover, changes in poses or observation perspectives also commonly exist in partial-person ReID. To the best of our knowledge, few works simultaneously focus on these two issues. In this work, we propose a novel texture semantic alignment (TSA) approach with the visibility-aware for partial person ReID task where the occlusion issue and changes in poses are simultaneously explored in an end-to-end unified framework. Specifically, we first employ a texture alignment scheme with the semantic visibility of a person's image to solve the issue of changes in poses that can enhance the alignment and generalization capability of the models. Second, we design a human pose-based partial region alignment scheme to solve the occlusion problem that makes TSA method emphasize the shared body parts. Finally, these two networks jointly learn these aspects. Extensive experimental results demonstrate that our proposed TSA method is very effective and robust for simultaneously handling occlusion and changes in pose, and it can outperform state-of-the-art approaches by a large margin and achieves an improvement of 5% and 6.4% on the rank-1 accuracy over the visibility-aware part model (VPM) method (published in CVPR 2019) on the Partial ReID and Partial-iLIDS datasets, respectively.

Original languageEnglish
Title of host publicationProceedings of the 28th ACM International Conference on Multimedia
EditorsPradeep K. Atrey, Zhu Li
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Pages3771-3779
Number of pages9
ISBN (Electronic)9781450379885
DOIs
Publication statusPublished - 2020
EventACM International Conference on Multimedia 2020 - Online, United States of America
Duration: 12 Oct 202016 Oct 2020
Conference number: 28th
https://dl.acm.org/doi/proceedings/10.1145/3394171 (Proceedings)

Conference

ConferenceACM International Conference on Multimedia 2020
Abbreviated titleMM 2020
Country/TerritoryUnited States of America
Period12/10/2016/10/20
Internet address

Keywords

  • human pose based partial region alignment
  • joint learning
  • partial person ReID
  • texture semantically aligned

Cite this