Shivakumara, Palaiahnakote and Banerjee, Ayan and Nandanwar, Lokesh and Pal, Umapada and Antonacopoulos, Apostolos and Lu, Tong and Blumenstein, Michael (2024) A new deep CNN for 3D text localization in the wild through shadow removal. Computer Vision and Image Understanding, 238. ISSN 1077-3142, DOI https://doi.org/10.1016/j.cviu.2023.103863.
Full text not available from this repository.Abstract
Text localization in the wild is challenging due to the presence of 2D and 3D texts, the presence of shadows, arbitrary orientated text with non-linear arrangements, varying lighting conditions as well as complex background. This paper proposes the first approach for 3D text localization in natural scene images through shadow removal and a new deep CNN model. In a first step, exploiting the observation that 3D text generates shadow information in natural scenes, the proposed model detects and removes the shadow pixels of 3D text based on the Generalized Gradient Vector Flow concept and a new clustering approach. The performance of the classification of 2D and 3D texts in the scene images is strengthened by using key features, including pixel strength, sharpness and edge potential, which are extracted to eliminate false text and shadow pixels. For text localization after removing shadow information, EfficientNet is used as an encoder (backbone) and UNet as a decoder in a novel way employing differential binarization. Experimental validation and comparative analysis with state-of-the-art approaches on both a new purpose-built dataset as well as on the benchmark datasets of ICDAR MLT 2019, ICDAR ArT 2019, CTW1500, DAST1500, Total-Text, and MSRATD500 for each of the different steps of the method, show that the proposed approach outperforms the existing methods.
| Item Type: | Article |
|---|---|
| Funders: | Ministry of Education, Malaysia [FRGS/1/2020/ICT02/UM/02/4], National Natural Science Foundation of China (NSFC) [61672273] |
| Uncontrolled Keywords: | Text localization; Gradient vector flow; Shadow removal; 3D text classification; 3D text localization |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Divisions: | Faculty of Computer Science & Information Technology > Department of Computer System & Technology |
| Depositing User: | Ms. Juhaida Abd Rahim |
| Date Deposited: | 05 Jul 2024 02:57 |
| Last Modified: | 05 Jul 2024 02:57 |
| URI: | http://eprints.um.edu.my/id/eprint/44304 |
Actions (login required)
 |
View Item |
