TY - JOUR
T1 - Pseudo-pair based self-similarity learning for unsupervised person re-identification
AU - Wu, Lin
AU - Liu, Deyin
AU - Zhang, Wenying
AU - Chen, Dapeng
AU - Ge, Zongyuan
AU - Boussaid, Farid
AU - Bennamoun, Mohammed
AU - Shen, Jialie
N1 - Funding Information:
This work was supported in part by the Australian Research Council under Grant DP210101682 and Grant DP210102674, in part by the Anhui Natural Science Foundation Anhui Energy Internet Joint Fund under Grant 2008085UD07, in part by the Anhui Provincial Key Research and Development Project under Grant 202104a07020029, and in part by the Natural Science Foundation of China under Grant 61876002.
Publisher Copyright:
© 1992-2012 IEEE.
PY - 2022
Y1 - 2022
N2 - Person re-identification (re-ID) is of great importance to video surveillance systems by estimating the similarity between a pair of cross-camera person shorts. Current methods for estimating such similarity require a large number of labeled samples for supervised training. In this paper, we present a pseudo-pair based self-similarity learning approach for unsupervised person re-ID without human annotations. Unlike conventional unsupervised re-ID methods that use pseudo labels based on global clustering, we construct patch surrogate classes as initial supervision, and propose to assign pseudo labels to images through the pairwise gradient-guided similarity separation. This can cluster images in pseudo pairs, and the pseudos can be updated during training. Based on pseudo pairs, we propose to improve the generalization of similarity function via a novel self-similarity learning:it learns local discriminative features from individual images via intra-similarity, and discovers the patch correspondence across images via inter-similarity. The intra-similarity learning is based on channel attention to detect diverse local features from an image. The inter-similarity learning employs a deformable convolution with a non-local block to align patches for cross-image similarity. Experimental results on several re-ID benchmark datasets demonstrate the superiority of the proposed method over the state-of-the-arts.
AB - Person re-identification (re-ID) is of great importance to video surveillance systems by estimating the similarity between a pair of cross-camera person shorts. Current methods for estimating such similarity require a large number of labeled samples for supervised training. In this paper, we present a pseudo-pair based self-similarity learning approach for unsupervised person re-ID without human annotations. Unlike conventional unsupervised re-ID methods that use pseudo labels based on global clustering, we construct patch surrogate classes as initial supervision, and propose to assign pseudo labels to images through the pairwise gradient-guided similarity separation. This can cluster images in pseudo pairs, and the pseudos can be updated during training. Based on pseudo pairs, we propose to improve the generalization of similarity function via a novel self-similarity learning:it learns local discriminative features from individual images via intra-similarity, and discovers the patch correspondence across images via inter-similarity. The intra-similarity learning is based on channel attention to detect diverse local features from an image. The inter-similarity learning employs a deformable convolution with a non-local block to align patches for cross-image similarity. Experimental results on several re-ID benchmark datasets demonstrate the superiority of the proposed method over the state-of-the-arts.
KW - Person re-identification
KW - Pseudo pair construction
KW - Self-similarity learning
KW - Unsupervised learning
UR - http://www.scopus.com/inward/record.url?scp=85134224438&partnerID=8YFLogxK
U2 - 10.1109/TIP.2022.3186746
DO - 10.1109/TIP.2022.3186746
M3 - Article
C2 - 35830405
AN - SCOPUS:85134224438
SN - 1057-7149
VL - 31
SP - 4803
EP - 4816
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
ER -