
1. 广东工业大学 自动化学院,广东,广州,510006
2. 广州番禺职业技术学院,广东,广州,511483
3. 深圳云动家体育科技有限公司,广东,深圳,518115
Published:2025
移动端阅览
刘嘉杰, 钟映春, 张钢, 等. 篮球比赛视频流中运动员身份的一致性跟踪研究[J]. 广东工业大学学报, 2025, 42(4): 48–58.
Liu Jiajie, Zhong Yingchun, Zhang Gang, et al. A Research on Consistent Tracking of Athlete Identities in Basketball Game Video Streams[J]. 2025, 42(4): 48-58.
刘嘉杰, 钟映春, 张钢, 等. 篮球比赛视频流中运动员身份的一致性跟踪研究[J]. 广东工业大学学报, 2025, 42(4): 48–58. DOI: 10.12052/gdutxb.240072
Liu Jiajie, Zhong Yingchun, Zhang Gang, et al. A Research on Consistent Tracking of Athlete Identities in Basketball Game Video Streams[J]. 2025, 42(4): 48-58. DOI: 10.12052/gdutxb.240072.
在篮球比赛视频流中,保持每个快速移动的运动员始终具有一致性的身份是重建运动员移动轨迹的关键环节之一。当前的主流算法在跟踪运动员时,普遍存在身份一致性跟踪精度较低的问题。为此,本文提出了3种改进策略:首先使用Soft-NMS (Soft-non-maximum Suppression) 和Focal EIoU (Efficient IoU) Loss代替原有的NMS (Non-maximum Suppression) 和损失函数,以提高运动员在被遮挡情况下的检测精度;其次提出了一种遮挡轨迹匹配机制,以解决运动员相互遮挡时的身份易混淆问题;最后增加了提取运动员号码牌数字特征的模块,并利用该特征匹配链接运动员在离开相机视野前和再次进入相机视野后的移动轨迹。在主流数据集上的实验结果表明,本文算法的HOTA (Higher Order Tracking Accuracy) 指标比原始DeepSORT (Deep Simple Online and Realtime Tracking) 算法分别提高了11.21和6.63个百分点,IDF1(IDF1 Score) 指标提高了15.56和10.11个百分点,身份变化次数(ID Switch
IDSW) 分别减少了36%和27%;与当前性能较优的OCSORT (Observation-Centric Simple Online and Realtime Tracking) 算法相比,本文算法的HOTA指标分别提高了2.39和0.98个百分点,MOTA (Multi-Object Tracking Accuracy) 指标分别提高了7.48和7.92个百分点。由此可见,本文提出的改进方法能够提高视频流中篮球运动员身份在全场比赛中的一致性,较有效地解决身份变化与混淆等问题,为重建运动员在全场比赛的移动轨迹奠定了基础。
The accuracy issues of player tracking in basketball game video streams due to occlusions and identity loss
which are crucial for reconstructing players' movement trajectories throughout the game
are addressed. To overcome the limitations of the DeepSORT algorithm in handling occlusions and maintaining identity consistency
three improvements are proposed. Firstly
the integration of Soft-NMS and Focal E-IoU loss functions enhances detection performance during occlusions. Secondly
an occlusion trajectory matching mechanism is introduced to reduce identity confusion when players occlude each other. Finally
a module for extracting and linking number plate features on players' jerseys is added to resolve identity changes when players re-enter the field of view. On main popular datasets
the proposed algorithm demonstrates significant improvements over the original DeepSORT with an 11.21 percentage points and 6.63 percentage points increase in the HOTA metric
a 15.56 percentage points and 10.11 percentage points improvement in the IDF1 metric
and a reduction of 36% and 27% in the number of identity changes. Compared with the competitive OCSORT algorithm
this method further enhances the HOTA metric by 2.39 percentage points and 0.98 percentage points
and the MOTA metric by 7.48 percentage points and 7.92 percentage points. The enhancements effectively improve the tracking precision of basketball players in video streams
particularly in dealing with challenges such as identity switches and occlusions
thereby laying a solid foundation for accurately reconstructing the full-game movement trajectories of athletes.
WANG X, XIAO T, JIANG Y, et al . Repulsion loss: detecting pedestrians in a crowd[C ] //Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR) . Utah: IEEE, 2018: 7774-7783.
ZHANG Y, SUN P, JIANG Y, et al . Bytetrack: multi-object tracking by associating every detection box[C ] //European Conference on Computer Vision(ECCV) . Tel Aviv, Israel: EACV, 2022: 1-21.
WANG Y H, HSIEH J W, CHEN P Y, et al . Smiletrack: similarity learning for occlusion-aware multiple object tracking[C ] // Proceedings of the AAAI Conference on Artificial Intelligence. Vancouver: AAAI, 2024, 38(6): 5740-5748.
BEWLEY A, GE Z, OTT L, et al . Simple online and realtime tracking[C ] //International Conference on Image Processing. Arizona: IEEE, 2016: 3464-3468.
DU Y, ZHAO Z, SONG Y, et al . Strongsort: make deepsort great again[J ] . IEEE Transactions on Multimedia, 2023, 25: 8725-8737.
CAO J, PANG J, WENG X, et al . Observation-centric sort: Rethinking sort for robust multi-object tracking[C ] //Computer Vision and Pattern Recognition(CVPR) . Vancouver: IEEE, 2023: 9686-9696.
WANG G, WANG Y, ZHANG H, et al . Exploit the connectivity: multi-object tracking with trackletnet[C ] //Proceedings of the 27th ACM International Conference on Multimedia. Nice: ACM, 2019: 482-490.
纵荣光. 基于多特征融合的篮球运动员追踪方法研究[D]. 重庆: 重庆邮电大学, 2023.
NICOLAI W, ALEX B, DIETRICH P. Simple online and realtime tracking with a deep association metric[C]//International Conference on Image Processing. Beijing: IEEE, 2017: 3645-3649.
WANG C Y, BOCHKOVSKIY A, LIAO H Y M. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Vancouver: IEEE, 2023: 7464-7475.
BODLA N, SINGH B, CHELLAPPA R, et al . Soft-NMS-improving object detection with one line of code[C ] //Proceedings of the IEEE International Conference on Computer Vision (ICCV) . Venice: IEEE, 2017: 5561-5569.
ZHANG Y F, REN W, ZHANG Z, et al . Focal and efficient IOU loss for accurate bounding box regression[J ] . Neurocomputing, 2022, 506: 146-157.
CUI Y, ZENG C, ZHAO X, et al . Sportsmot: a large multi-object tracking dataset in multiple sports scenes[C ] //Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) . Paris: IEEE, 2023: 9921-9931.
SCOTT A, UCHIDA I, DING N, et al . TeamTrack: a dataset for multi-sport multi-object tracking in full-pitch videos[C ] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington: IEEE, 2024: 3357-3366.
ZHENG Z, WANG P, LIU W, et al . Distance-IoU loss: faster and better learning for bounding box regression[C ] //Proceedings of the AAAI Conference on Artificial Intelligence. New York: AAAI, 2020, 34(7): 12993-13000.
LI Z M, WANG Y F, LIU Y J, et al . Pose feature fusion based short track speed skaters multi object tracking[J ] . Journal of Computer-aided Design Computer Graphics, 2023, 35(8): 1279-1288.
伍万能. 复杂体育运动场景中目标跟踪方法研究[D]. 长沙: 湖南大学, 2020.
YANG M, HAN G, YAN B, et al . Hybrid-sort: weak cues matter for online multi-object tracking[C ] //Proceedings of the AAAI Conference on Artificial Intelligence. Vancouver: AAAI, 2024, 38(7): 6504-6512.
WANG Z, ZHENG L, LIU Y, et al . Towards real-time multi-object tracking[C ] //European Conference on Computer Vision (ECCV) . Online: EACV, 2020: 107-122.
ZHANG Y, WANG C, WANG X, et al . Fairmot: on the fairness of detection and re-identification in multiple object tracking[J ] . International Journal of Computer Vision, 2021, 129: 3069-3087.
YAN Y, LI J, QIN J, et al . Efficient person search: an anchor-free approach[J ] . International Journal of Computer Vision, 2023, 131(7): 1642-1661.
HUANG J H, WANG Z Y. A research on deep learning object detection algorithm based on feature fusion[J]. Journal of Guangdong University of Technology, 2021, 38(4): 52-58.
ZHOU X, YAO C, WEN H, et al . East: an efficient and accurate scene text detector[C ] //Proceedings of the IEEE conference on Computer Vision and Pattern Recognition (CVPR) . Hawaii: IEEE, 2017: 5551-5560.
HE K, ZHANG X, REN S, et al . Deep residual learning for image recognition[C ] //Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Nevada: IEEE 2016: 770 -778.
KUHN H W. The Hungarian method for the assignment problem[J]. Naval Research Logistics Quarterly, 1955, 2(12): 83-97.
BERNARDIN K, STIEFELHAGEN R. Evaluating multiple object tracking performance: the clear mot metrics[J]. EURASIP Journal on Image and Video Processing, 2008(246309): 1-10.
LUITEN J, OSEP A, DENDORFER P, et al . Hota: a higher order metric for evaluating multi-object tracking[J ] . International Journal of Computer Vision, 2021, 129: 548-578.
0
Views
0
下载量
0
CSCD
Publicity Resources
Related Articles
Related Author
Related Institution
京公网安备11010802024621