A new ontology-based multimodal classification system for social media images of personality traits

Biswas, Kunal and Shivakumara, Palaiahnakote and Pal, Umapada and Lu, Tong (2023) A new ontology-based multimodal classification system for social media images of personality traits. Signal, Image and Video Processing, 17 (2). pp. 543-551. ISSN 1863-1703, DOI https://doi.org/10.1007/s11760-022-02259-3.

Full text not available from this repository.

Abstract

Number of users of social media is increasing exponentially. People are getting addicted to social media, and because of such addiction, it sometimes causes psychological and mental effects on the users. Understanding user interaction with social media is essential to study personality traits of the users. This paper focuses on classification of personality traits called Big Five factors, namely (i) agreeableness, (ii) conscientiousness, (iii) neuroticism, (iv) extraversion and (v) openness by combining image and textual features through ontology and fully connected neural network (FCNN). The intuition to classify the images of the five classes is that there is a strong correlation between images, profile picture, images of status, text in the images, description of the images uploaded on social media and the person's mind. To extract such observation, we explore an ontology-based approach, which constructs a weighted undirected graph (WUG) based on labels of the images, profile picture, banner image, text in

Item Type: Article
Funders: UNSPECIFIED
Uncontrolled Keywords: Social meida; Ontology; Multimodal; Undirected graphs; Personality traits
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
T Technology > T Technology (General)
Divisions: Faculty of Computer Science & Information Technology
Faculty of Computer Science & Information Technology > Department of Computer System & Technology
Depositing User: Ms Zaharah Ramly
Date Deposited: 04 Nov 2024 01:07
Last Modified: 04 Nov 2024 01:07
URI: http://eprints.um.edu.my/id/eprint/39540

Actions (login required)

View Item View Item