TPM: Multiple object tracking with tracklet-plane matching

Jinlong Peng, Tao Wang, Weiyao Lin*, Jian Wang, John See, Shilei Wen, Erui Ding

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

90 Citations (Scopus)


Multiple object tracking (MOT) aims to model the temporal relationship among detected objects and associate them into trajectories. Thus, one major challenge of MOT lies in the confusion from noisy object detection results. In this paper, we propose Tracklet-Plane Matching (TPM), a new approach which improves the performance of MOT by modeling and reducing the interferences from noisy or confusing object detections. TPM first constructs good temporally-related object detections into short tracklets. Then, a tracklet-plane matching process is introduced to organize related tracklets into planes and associate them into long trajectories. The tracklet-plane matching process assigns visually confusing tracklets into different tracklet planes according to their contextual information, thus properly reducing the confusion among similar tracklets. At the same time, it also allows association among temporally non-neighboring or overlapping tracklets, which provides good flexibility to handle confusion from noisy detections. Under this process, a tracklet-importance evaluation scheme and a representative-based similarity modeling scheme are introduced. These two schemes can properly evaluate the reliability of detection results and identify reliable ones during association so that the impact of noisy or confusing detections can be well-mitigated. Experimental results on benchmark datasets demonstrate that the proposed approach outperforms the state-of-the-art MOT methods.

Original languageEnglish
Article number107480
JournalPattern Recognition
Early online date30 May 2020
Publication statusPublished - Nov 2020


  • Multiple object tracking
  • Representative-selection network
  • Tracklet
  • Tracklet-plane

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'TPM: Multiple object tracking with tracklet-plane matching'. Together they form a unique fingerprint.

Cite this