Rough-fuzzy based scene categorization for text detection and recognition in video

Roy, Sangheeta and Shivakumara, Palaiahnakote and Jain, Namita and Khare, Vijeta and Dutta, Anjan and Pal, Umapada and Lu, Tong (2018) Rough-fuzzy based scene categorization for text detection and recognition in video. Pattern Recognition, 80. pp. 64-82. ISSN 0031-3203, DOI

Full text not available from this repository.
Official URL:


Scene image or video understanding is a challenging task especially when number of video types increases drastically with high variations in background and foreground. This paper proposes a new method for categorizing scene videos into different classes, namely, Animation, Outlet, Sports, e-Learning, Medical, Weather, Defense, Economics, Animal Planet and Technology, for the performance improvement of text detection and recognition, which is an effective approach for scene image or video understanding. For this purpose, at first, we present a new combination of rough and fuzzy concept to study irregular shapes of edge components in input scene videos, which helps to classify edge components into several groups. Next, the proposed method explores gradient direction information of each pixel in each edge component group to extract stroke based features by dividing each group into several intra and inter planes. We further extract correlation and covariance features to encode semantic features located inside planes or between planes. Features of intra and inter planes of groups are then concatenated to get a feature matrix. Finally, the feature matrix is verified with temporal frames and fed to a neural network for categorization. Experimental results show that the proposed method outperforms the existing state-of-the-art methods, at the same time, the performances of text detection and recognition methods are also improved significantly due to categorization.

Item Type: Article
Funders: National Natural Science Foundation of China under Grant No. 61672273, No. 61272218 and No. 61321491, Science Foundation for Distinguished Young Scholars of Jiangsu under Grant No. BK20160021, University of Malaya HIR under Grant No: M.C/625/1/HIR/210
Uncontrolled Keywords: Rough set; Fuzzy set; Video categorization; Scene image classification; Video text detection; Video text recognition
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Computer Science & Information Technology
Depositing User: Ms. Juhaida Abd Rahim
Date Deposited: 09 Apr 2019 08:14
Last Modified: 09 Apr 2019 08:14

Actions (login required)

View Item View Item