Biswas, Kunal and Shivakumara, Palaiahnakote and Pal, Umapada and Lu, Tong and Blumenstein, Michael and Llados, Josep (2023) Classification of aesthetic natural scene images using statistical and semantic features. Multimedia Tools and Applications, 82 (9). pp. 13507-13532. ISSN 1380-7501, DOI https://doi.org/10.1007/s11042-022-13924-7.
Full text not available from this repository.Abstract
Aesthetic image analysis is essential for improving the performance of multimedia image retrieval systems, especially from a repository of social media and multimedia content stored on mobile devices. This paper presents a novel method for classifying aesthetic natural scene images by studying the naturalness of image content using statistical features, and reading text in the images using semantic features. Unlike existing methods that focus only on image quality with human information, the proposed approach focuses on image features as well as text-based semantic features without human intervention to reduce the gap between subjectivity and objectivity in the classification. The aesthetic classes considered in this work are (i) Very Pleasant, (ii) Pleasant, (iii) Normal and (iv) Unpleasant. The naturalness is represented by features of focus, defocus, perceived brightness, perceived contrast, blurriness and noisiness, while semantics are represented by text recognition, description of the images and labels of images, profile pictures, and banner images. Furthermore, a deep learning model is proposed in a novel way to fuse statistical and semantic features for the classification of aesthetic natural scene images. Experiments on our own dataset and the standard datasets demonstrate that the proposed approach achieves 92.74%, 88.67% and 83.22% average classification rates on our own dataset, AVA dataset and CUHKPQ dataset, respectively. Furthermore, a comparative study of the proposed model with the existing methods shows that the proposed method is effective for the classification of aesthetic social media images.
| Item Type: | Article |
|---|---|
| Funders: | Universiti Malaya (GPF096A-2020), Universiti Malaya (GPF096B-2020), Universiti Malaya (GPF096C-2020) |
| Uncontrolled Keywords: | Scene images; Personality traits; Person behaviour; Color features; Deep learning; Aesthetic images |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Divisions: | Faculty of Computer Science & Information Technology |
| Depositing User: | Ms Zaharah Ramly |
| Date Deposited: | 27 Jun 2023 02:57 |
| Last Modified: | 27 Jun 2023 02:57 |
| URI: | http://eprints.um.edu.my/id/eprint/39432 |
Actions (login required)
 |
View Item |
