A new unified method for detecting text from marathon runners and sports players in video (PR-D-19-01078R2)

Nag, Sauradip and Shivakumara, Palaiahnakote and Pal, Umapada and Lu, Tong and Blumenstein, Michael (2020) A new unified method for detecting text from marathon runners and sports players in video (PR-D-19-01078R2). PATTERN RECOGNITION, 107. ISSN 00313203, DOI https://doi.org/10.1016/j.patcog.2020.107476.

Full text not available from this repository.

Abstract

Detecting text located on the torsos of marathon runners and sports players in video is a challenging issue due to poor quality and adverse effects caused by flexible/colorful clothing, and different structures of human bodies or actions. This paper presents a new unified method for tackling the above challenges. The proposed method fuses gradient magnitude and direction coherence of text pixels in a new way for detecting candidate regions. Candidate regions are used for determining the number of temporal frame clusters obtained by K-means clustering on frame differences. This process in turn detects key frames. The proposed method explores Bayesian probability for skin portions using color values at both pixel and component levels of temporal frames, which provides fused images with skin components. Based on skin information, the proposed method then detects faces and torsos by finding structural and spatial coherences between them. We further propose adaptive pixels linking a deep learning model for text detection from torso regions. The proposed method is tested on our own dataset collected from marathon/sports video and three standard datasets, namely, RBNR, MMM and R-ID of marathon images, to evaluate the performance. In addition, the proposed method is also tested on the standard natural scene datasets, namely, CTW1500 and MS-COCO text datasets, to show the objectiveness of the proposed method. A comparative study with the state-of-the-art methods on bib number/text detection of different datasets shows that the proposed method outperforms the existing methods. (C) 2020 Elsevier Ltd. All rights reserved.

Item Type: Article
Funders: Japan Society for the Promotion of Science, National Natural Science Foundation of China (Grant No. 61672273, 61832008, GPF014D-2019), Universiti Malaya
Uncontrolled Keywords: Video text analysis; Gradient direction; Bayesian classifier; Face detection; Torso detection; Deep learning; Text detection
Subjects: T Technology > T Technology (General)
Divisions: Faculty of Computer Science & Information Technology
Depositing User: Ms Zaharah Ramly
Date Deposited: 28 Dec 2023 12:40
Last Modified: 28 Dec 2023 12:40
URI: http://eprints.um.edu.my/id/eprint/36308

Actions (login required)

View Item View Item