基于相机感知多样代理的无监督行人重识别

Camera-aware Diverse Proxies Based Unsupervised Person Re-identification

  • 摘要: 基于聚类的无监督行人重识别通过聚类产生伪标签,并以此为每个聚类构建单一代理。但不同相机之间的差异以及同一相机下行人不同姿态方向等导致的相机类内差异使得单一代理无法充分表示整个复杂聚类,进而影响训练过程和模型的性能。为此,本文提出基于相机感知多样代理的无监督行人重识别方法来消除相机差异和相机类内差异,以提高类内样本的紧密性。相机感知多样代理包括相机多代理和相机差异代理。其中相机多代理为每个相机类构建一个平均代理和一个硬代理,通过互补表示来提高相机类内样本的紧密性。同时还会为每个相机类构建一个相机差异代理,相机差异代理会利用不同相机类的平均代理进行更新,以此拉近相机之间的距离,减少相机差异。相机差异代理和相机多代理相互协作,提高类内样本紧密性和模型性能。本文方法在Martket1501、DukeMTMC-reID、MSMT17三个数据集上mAP/Rank-1分别达到了90.4%/96.4%、75.8%/86.5%、58.2%/82.5%。

     

    Abstract: Cluster-based unsupervised person re-identification generates pseudo labels through clustering and constructs a single proxy for each cluster. However, inter-camera discrepancies between different cameras and intra-camera differences caused by pedestrians' different stepping directions under the same camera make it impossible for a single proxy to adequately represent the whole complex cluster, affecting the training process and model performance. Thus, a camera-aware diverse proxies based unsupervised person re-identification method is proposed to eliminate inter-camera discrepancies and intra-camera differences in order to improve the intra-class tightness. Camera-aware diverse proxies include camera multi proxies and camera discrepancy proxy. The camera multi proxies construct a mean proxy and a hard proxy for each camera class to improve intra-camera tightness through complementary representation. A camera discrepancy proxy is also constructed for each camera class, which utilizes the mean proxies of different camera classes for updating, so as to bring cameras closer to each other and reduce camera discrepancy. The camera discrepancy proxy and camera multi proxies collaborate with each other to improve intra-class tightness and model performance. The proposed method achieves 90.4%/96.4%, 75.8%/86.5%, and 58.2%/82.5% for mAP/Rank-1 on the Martket1501, DukeMTMC-reID, and MSMT17 datasets, respectively.

     

/

返回文章
返回