Racing Bib Number Recognition Method using Deep Learning

Muhammad Aditya Rayhan, Kemas Muslim Lhaksmana

Abstract


Mass running event has gained popularity ever since recreational running becomes more common as they often held annually by various organizers. As image documentation took a huge part to showcase the event, many thousands of images were generated during the event. Along with thousands of images that were generated, the participant is unlikely to found an image of themselves. To solve this problem, image annotation could be performed to address image with specific tags such as participant attribute like racing bib number (RBN). Manually annotate thousands of images would result in inefficiency of time and hard-labor. As a work to tackle this problem, this paper proposed an automatic image annotation system using the YOLOv3 algorithm based RBN recognition method. The experiment result shows 83.0% precision, 81.5% recall, and 82.2% F1 score as a result of our proposed method on running event dataset. Therefore, this implemented method will promote efficiency to solve the image annotation problem because it doesn't require manual annotation over thousand of running event images

Keywords


Racing Bib Number, Object Detection, Automatic Annotation, CNN, Object Recognition

Full Text:

PDF

References


J. Scheerder, K. Breedveld, and J. Borgers, “Who Is Doing a Run with the Running Boom?,†in Running across Europe, 2015.

H. Liu and B. Bhanu, “Pose-guided R-CNN for jersey number recognition in sports,†in IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2019, doi: 10.1109/CVPRW.2019.00301.

I. J. Goodfellow, Y. Bulatov, J. Ibarz, S. Arnoud, and V. Shet, “Multi-digit number recognition from street view imagery using deep convolutional neural networks,†in 2nd International Conference on Learning Representations, ICLR 2014 - Conference Track Proceedings, 2014.

G. Li, S. Xu, X. Liu, L. Li, and C. Wang, “Jersey number recognition with semi-supervised spatial transformer network,†in IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2018, doi: 10.1109/CVPRW.2018.00231.

I. Ben-Ami, T. Basha, and S. Avidan, “Racing bib number recognition,†in BMVC 2012 - Electronic Proceedings of the British Machine Vision Conference 2012, 2012, doi: 10.5244/C.26.19.

S. Roy, P. Shivakumara, P. Mondal, R. Raghavendra, U. Pal, and T. Lu, “A new multi-modal technique for bib number/text detection in natural images,†in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2015, vol. 9314, pp. 483–494, doi: 10.1007/978-3-319-24075-6_47.

P. Shivakumara, R. Raghavendra, L. Qin, K. B. Raja, T. Lu, and U. Pal, “A new multi-modal approach to bib number/text detection and recognition in Marathon images,†Pattern Recognit., 2017, doi: 10.1016/j.patcog.2016.08.021.

A. Apap and D. Seychell, “Marathon bib number recognition using deep learning,†in International Symposium on Image and Signal Processing and Analysis, ISPA, 2019, doi: 10.1109/ISPA.2019.8868768.

B. Shi, X. Bai, and C. Yao, “An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition,†IEEE Trans. Pattern Anal. Mach. Intell., 2017, doi: 10.1109/TPAMI.2016.2646371.

Y. C. Wong, L. J. Choi, R. S. S. Singh, H. Zhang, and A. R. Syafeeza, “Deep learning-based racing bib number detection and recognition,†Jordanian J. Comput. Inf. Technol., 2019, doi: 10.5455/jjcit.71-1562747728.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,†in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016, doi: 10.1109/CVPR.2016.91.

R. Girshick, J. Donahue, T. Darrell, U. C. Berkeley, and J. Malik, “R-CNN,†1311.2524v5, 2014, doi: 10.1109/CVPR.2014.81.

J. Redmon and A. Farhadi, “YOLO9000: Better, faster, stronger,†in Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017, doi: 10.1109/CVPR.2017.690.

J. Redmon and A. Farhadi, “Yolov3,†Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2017, doi: 10.1109/CVPR.2017.690.

M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, “The pascal visual object classes (VOC) challenge,†Int. J. Comput. Vis., 2010, doi: 10.1007/s11263-009-0275-4.

H. Rezatofighi, N. Tsoi, J. Gwak, A. Sadeghian, I. Reid, and S. Savarese, “Generalized intersection over union: A metric and a loss for bounding box regression,†in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2019, doi: 10.1109/CVPR.2019.00075.




DOI: https://doi.org/10.30865/mib.v4i3.2270

Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 JURNAL MEDIA INFORMATIKA BUDIDARMA

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.


JURNAL MEDIA INFORMATIKA BUDIDARMA
Universitas Budi Darma
Secretariat: Sisingamangaraja No. 338 Telp 061-7875998
Email: mib.stmikbd@gmail.com

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.