TY - JOUR
T1 - Person Re-Identification by Context-aware Part Attention and Multi-Head Collaborative Learning
AU - Wu, Dongming
AU - Ye, Mang
AU - Lin, Gaojie
AU - Gao, Xin
AU - Shen, Jianbing
N1 - KAUST Repository Item: Exported on 2021-04-28
Acknowledged KAUST grant number(s): REI/1/0018-01-01, REI/1/4216-01-01, REI/1/4437-01-01, URF/1/4077-01-01
Acknowledgements: This work was supported in part by the King Abdullah University of Science and Technology (KAUST) under the Awards (REI/1/0018-01-01, REI/1/4216-01-01, REI/1/4437-01-01 and URF/1/4077-01-01), and CAAI-Huawei MindSpore Open Fund.
PY - 2021
Y1 - 2021
N2 - Most existing works solve the video-based person re-identification (re-ID) problem by computing the representation of each frame independently and finally aggregate the frame-level features. However, these methods often suffer from the challenging factors in videos, such as serious occlusion, background clutter and pose variation. To address these issues, we propose a novel multi-level Context-aware Part Attention (CPA) model to learn discriminative and robust local part features. It is featured in two aspects: 1) the context-aware part attention module improves the robustness by capturing the global relationship among different body parts across different video frames, and 2) the attention module is further extended to multi-level attention mechanism which enhances the discriminability by simultaneously considering low- to high-level features in different convolutional layers. In addition, we propose a novel multi-head collaborative training scheme to improve the performance, which is collaboratively supervised by multiple heads with the same structure but different parameters. It contains two consistency regularization terms, which consider both multi-head and multi-frame consistency to achieve better results. The multi-level CPA model is designed for feature extraction, while the multi-head collaborative training scheme is designed for classifier supervision. They jointly improve our re-ID model from two complementary directions. Extensive experiments demonstrate that the proposed method achieves much better or at least comparable performance compared to the state-of-the-art on four video re-ID datasets.
AB - Most existing works solve the video-based person re-identification (re-ID) problem by computing the representation of each frame independently and finally aggregate the frame-level features. However, these methods often suffer from the challenging factors in videos, such as serious occlusion, background clutter and pose variation. To address these issues, we propose a novel multi-level Context-aware Part Attention (CPA) model to learn discriminative and robust local part features. It is featured in two aspects: 1) the context-aware part attention module improves the robustness by capturing the global relationship among different body parts across different video frames, and 2) the attention module is further extended to multi-level attention mechanism which enhances the discriminability by simultaneously considering low- to high-level features in different convolutional layers. In addition, we propose a novel multi-head collaborative training scheme to improve the performance, which is collaboratively supervised by multiple heads with the same structure but different parameters. It contains two consistency regularization terms, which consider both multi-head and multi-frame consistency to achieve better results. The multi-level CPA model is designed for feature extraction, while the multi-head collaborative training scheme is designed for classifier supervision. They jointly improve our re-ID model from two complementary directions. Extensive experiments demonstrate that the proposed method achieves much better or at least comparable performance compared to the state-of-the-art on four video re-ID datasets.
UR - http://hdl.handle.net/10754/668975
UR - https://ieeexplore.ieee.org/document/9416422/
U2 - 10.1109/TIFS.2021.3075894
DO - 10.1109/TIFS.2021.3075894
M3 - Article
SN - 1556-6021
JO - IEEE Transactions on Information Forensics and Security
JF - IEEE Transactions on Information Forensics and Security
ER -