Chaudhuri, Abhra and Shivakumara, Palaiahnakote and Chowdhury, Pinaki Nath and Pal, Umapada and Lu, Tong and Lopresti, Daniel and Kumar, Govindaraj Hemantha (2021) A deep action-oriented video image classification system for text detection and recognition. SN Applied Sciences, 3 (11). ISSN 2523-3971, DOI https://doi.org/10.1007/s42452-021-04821-z.
Full text not available from this repository.Abstract
For the video images with complex actions, achieving accurate text detection and recognition results is very challenging. This paper presents a hybrid model for classification of action-oriented video images which reduces the complexity of the problem to improve text detection and recognition performance. Here, we consider the following five categories of genres, namely concert, cooking, craft, teleshopping and yoga. For classifying action-oriented video images, we explore ResNet50 for learning the general pixel-distribution level information and the VGG16 network is implemented for learning the features of Maximally Stable Extremal Regions and again another VGG16 is used for learning facial components obtained by a multitask cascaded convolutional network. The approach integrates the outputs of the three above-mentioned models using a fully connected neural network for classification of five action-oriented image classes. We demonstrated the efficacy of the proposed method by testing on our dataset and two other standard datasets, namely, Scene Text Dataset dataset which contains 10 classes of scene images with text information, and the Stanford 40 Actions dataset which contains 40 action classes without text information. Our method outperforms the related existing work and enhances the class-specific performance of text detection and recognition, significantly.
| Item Type: | Article |
|---|---|
| Funders: | National Natural Science Foundation of China (NSFC)[61672273], FRGS, University of Malaya, Malaysia[FP104-2020], Technology Innovation Hub of Indian Statistical Institute, Kolkata |
| Uncontrolled Keywords: | Deep neural networks;Face detection;Action image classification;Text detection;Text recognition |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Divisions: | Faculty of Computer Science & Information Technology |
| Depositing User: | Ms Zaharah Ramly |
| Date Deposited: | 07 Sep 2022 06:32 |
| Last Modified: | 07 Sep 2022 06:32 |
| URI: | http://eprints.um.edu.my/id/eprint/34804 |
Actions (login required)
 |
View Item |
