Racing Bib Number Recognition Method using Deep Learning
DOI:
https://doi.org/10.30865/mib.v4i3.2270Keywords:
Racing Bib Number, Object Detection, Automatic Annotation, CNN, Object RecognitionAbstract
Mass running event has gained popularity ever since recreational running becomes more common as they often held annually by various organizers. As image documentation took a huge part to showcase the event, many thousands of images were generated during the event. Along with thousands of images that were generated, the participant is unlikely to found an image of themselves. To solve this problem, image annotation could be performed to address image with specific tags such as participant attribute like racing bib number (RBN). Manually annotate thousands of images would result in inefficiency of time and hard-labor. As a work to tackle this problem, this paper proposed an automatic image annotation system using the YOLOv3 algorithm based RBN recognition method. The experiment result shows 83.0% precision, 81.5% recall, and 82.2% F1 score as a result of our proposed method on running event dataset. Therefore, this implemented method will promote efficiency to solve the image annotation problem because it doesn't require manual annotation over thousand of running event imagesReferences
J. Scheerder, K. Breedveld, and J. Borgers, “Who Is Doing a Run with the Running Boom?,†in Running across Europe, 2015.
H. Liu and B. Bhanu, “Pose-guided R-CNN for jersey number recognition in sports,†in IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2019, doi: 10.1109/CVPRW.2019.00301.
I. J. Goodfellow, Y. Bulatov, J. Ibarz, S. Arnoud, and V. Shet, “Multi-digit number recognition from street view imagery using deep convolutional neural networks,†in 2nd International Conference on Learning Representations, ICLR 2014 - Conference Track Proceedings, 2014.
G. Li, S. Xu, X. Liu, L. Li, and C. Wang, “Jersey number recognition with semi-supervised spatial transformer network,†in IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2018, doi: 10.1109/CVPRW.2018.00231.
I. Ben-Ami, T. Basha, and S. Avidan, “Racing bib number recognition,†in BMVC 2012 - Electronic Proceedings of the British Machine Vision Conference 2012, 2012, doi: 10.5244/C.26.19.
S. Roy, P. Shivakumara, P. Mondal, R. Raghavendra, U. Pal, and T. Lu, “A new multi-modal technique for bib number/text detection in natural images,†in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2015, vol. 9314, pp. 483–494, doi: 10.1007/978-3-319-24075-6_47.
P. Shivakumara, R. Raghavendra, L. Qin, K. B. Raja, T. Lu, and U. Pal, “A new multi-modal approach to bib number/text detection and recognition in Marathon images,†Pattern Recognit., 2017, doi: 10.1016/j.patcog.2016.08.021.
A. Apap and D. Seychell, “Marathon bib number recognition using deep learning,†in International Symposium on Image and Signal Processing and Analysis, ISPA, 2019, doi: 10.1109/ISPA.2019.8868768.
B. Shi, X. Bai, and C. Yao, “An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition,†IEEE Trans. Pattern Anal. Mach. Intell., 2017, doi: 10.1109/TPAMI.2016.2646371.
Y. C. Wong, L. J. Choi, R. S. S. Singh, H. Zhang, and A. R. Syafeeza, “Deep learning-based racing bib number detection and recognition,†Jordanian J. Comput. Inf. Technol., 2019, doi: 10.5455/jjcit.71-1562747728.
J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,†in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016, doi: 10.1109/CVPR.2016.91.
R. Girshick, J. Donahue, T. Darrell, U. C. Berkeley, and J. Malik, “R-CNN,†1311.2524v5, 2014, doi: 10.1109/CVPR.2014.81.
J. Redmon and A. Farhadi, “YOLO9000: Better, faster, stronger,†in Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017, doi: 10.1109/CVPR.2017.690.
J. Redmon and A. Farhadi, “Yolov3,†Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2017, doi: 10.1109/CVPR.2017.690.
M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, “The pascal visual object classes (VOC) challenge,†Int. J. Comput. Vis., 2010, doi: 10.1007/s11263-009-0275-4.
H. Rezatofighi, N. Tsoi, J. Gwak, A. Sadeghian, I. Reid, and S. Savarese, “Generalized intersection over union: A metric and a loss for bounding box regression,†in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2019, doi: 10.1109/CVPR.2019.00075.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
