徐辛超, 李旭佳, 徐彦田, 陈晨辰, 刘明岳, 朱佳武, 赵红喜, 程博. 一种适合垂直镜头的实时跨镜连续跟踪方法[J]. 武汉大学学报 ( 信息科学版), 2021, 46(8): 1247-1258. DOI: 10.13203/j.whugis20190333
引用本文: 徐辛超, 李旭佳, 徐彦田, 陈晨辰, 刘明岳, 朱佳武, 赵红喜, 程博. 一种适合垂直镜头的实时跨镜连续跟踪方法[J]. 武汉大学学报 ( 信息科学版), 2021, 46(8): 1247-1258. DOI: 10.13203/j.whugis20190333
XU Xinchao, LI Xujia, XU Yantian, CHEN Chenchen, LIU Mingyue, ZHU Jiawu, ZHAO Hongxi, CHENG Bo. A Real⁃Time Cross⁃Lens Continuous Tracking Method for Vertical Mounted Cameras[J]. Geomatics and Information Science of Wuhan University, 2021, 46(8): 1247-1258. DOI: 10.13203/j.whugis20190333
Citation: XU Xinchao, LI Xujia, XU Yantian, CHEN Chenchen, LIU Mingyue, ZHU Jiawu, ZHAO Hongxi, CHENG Bo. A Real⁃Time Cross⁃Lens Continuous Tracking Method for Vertical Mounted Cameras[J]. Geomatics and Information Science of Wuhan University, 2021, 46(8): 1247-1258. DOI: 10.13203/j.whugis20190333

一种适合垂直镜头的实时跨镜连续跟踪方法

A Real⁃Time Cross⁃Lens Continuous Tracking Method for Vertical Mounted Cameras

  • 摘要: 针对现有效果较好的单镜头跟踪方法不能满足工程化的实时性要求,而现有行人重识别方法依赖于行人检测方法建立行人图像库,可能出现漏检和误检等问题,提出了一种适合垂直镜头的实时跨镜连续跟踪方法。首先,采用高斯混合模型进行背景消除,并提取目标的最小外接矩形用于跟踪目标的选择; 然后,采用改进空间可靠性和探测可靠性的相关滤波方法实现单镜头中的目标跟踪。针对垂直镜头的行人成像特点,采用加速稳健特征(speeded up robust features, SURF)匹配计算相邻镜头间的单应矩阵,确定跟踪目标在下一镜头中的最佳搜索区域; 通过高斯混合模型背景消除和模板匹配实现了行人的实时跨镜连续跟踪。采用垂直安置的4个摄像头进行了跟踪测试。实验结果表明,与当前主流方法相比,该方法在保持跟踪稳定性的基础上具有更好的跟踪效率,可以达到21.8帧/s,且在光照变化、形变、复杂背景和遮挡情况下跟踪优势更显著,跨摄像头连续跟踪效果稳定。

     

    Abstract:
      Objectives  Target tracking has been widely used in pedestrian tracking, automatic driving, target monitoring and other fields. The existing tracking methods in single camera have limited tracking range and relatively slow. The existing person re-identification methods rely on the pedestrian detection to establish image database, and all the methods may miss detection or lead to false detection. Therefore, in order to meet the needs of pedestrian tracking in large-scale scenes, a continuous pedestrian tracking method for vertical mounted camera is studied, which has better tracking robustness and faster speed.
      Methods  For tracking in a single camera, a discriminative correlation filter with detection and spatial reliability (DSR-DCF) was proposed. Firstly, the Gaussian mixture model was used to eliminate the background, and the minimum circumscribed rectangle of the target was extracted to select the tracking target. Then, 32 dimensional histogram of oriented gradient (HOG) feature and 1 dimensional grayscale feature are used as pedestrian feature description, and spatial reliability and detection reliability are applied to correlation filter to realize pedestrian tracking in single camera. In the process of tracking pedestrians across cameras, according to the imaging characteristics of pedestrians in the vertical mounted camera, the speeded up robust features (SURF) algorithm was used to match the features of overlapping areas. The homography matrix between adjacent shots was calculated according to the matching feature points to determine the best search area of tracking target in the adjacent camera. Finally, taking the pedestrian obtained by Gaussian mixture model background elimination in the search area and template pedestrian as input, and using the sum of absolute difference(SAD) as the matching measure, the real-time cross-lens continuous tracking of pedestrian was realized through template matching.
      Results  Scene simulation and tracking experiments were carried out with four cameras with a resolution of 1 920×1 080 pixels. The success rate was tested by online object tracking benchmark (OTB), and compared with kernelized correlation filters (KCF), discriminative correlation gilter with channel and spatial reliability (CSR-DCF) and other methods. The results show that the background elimination of Gaussian mixture model can extract all pedestrians, and there is no missing or false detection. When tracking across cameras, the best search range is 5 times of the initial tracking window size. In continuous tracking, the average speed of the proposed method can reach 21.8 frames/ s, and the tracking success rate is better, especially in the case of illumination change, deformation, complex background and occlusion.
      Conclusions  The single camera tracking method DSR-DCF, combined with search area restriction and template matching, can realize the continuous pedestrian tracking across camera. The tracking speed and success rate can meet the real-time requirements, and the tracking speed is better than 21 frames/s.

     

/

返回文章
返回