Deformable scene text detection using harmonic features and modified pixel aggregation network

Jain, Tanmay and Palaiahnakote, Shivakumara and Pal, Umapada and Liu, Cheng-Lin (2021) Deformable scene text detection using harmonic features and modified pixel aggregation network. Pattern Recognition Letters, 152. pp. 135-142. ISSN 0167-8655, DOI

Full text not available from this repository.


Although text detection methods have addressed several challenges in the past, there is a dearth of effective methods for text detection in deformable images, such as images containing text embedded on cloth, banners, rubber, sports jerseys, uniforms, etc. This is because deformable regions contain surfaces of arbitrarily shapes, which lead to poor text quality. This paper presents a new method for deformable text detection in natural scene images. It is observed that although the shapes of characters change in a deformable region, the pixel values and spatial relationship between the pixels do not change. This motivated us to explore extraction of Maximally Stable Extremal Regions (MSER) in an image in which pixels that share common features are grouped into components. The unique character shape variations led us to explore harmonic features to represent the component shape variations, using which a classifier classifies text and non-text components from the output of the MSER step. Additionally, the objective of developing a lightweight method with low computational cost motivated us to introduce a modified Pixel Aggression Network (PAN) for text deformable text detection at a component level. Comprehensive experiments which include experiments on our Deformable Text Dataset (DTD) and standard natural scene text datasets, namely, MSRATD-500, ICDAR 2019 MLT, Total-Text, CTW1500, ICDAR 2019 ArT and DSTA1500 datasets show that the proposed model outperforms the existing methods for our dataset as well as the standard datasets. (c) 2021 Elsevier B.V. All rights reserved.

Item Type: Article
Uncontrolled Keywords: Natural scene text detection; Maximally stable extremal region; Fourier harmonic features; Pixel aggregation network; Deep learning models; Deformable text detection
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Computer Science & Information Technology > Department of Computer System & Technology
Depositing User: Ms. Juhaida Abd Rahim
Date Deposited: 28 Feb 2022 00:48
Last Modified: 28 Feb 2022 00:48

Actions (login required)

View Item View Item