Improving multi-label text classification using weighted information gain and co-trained Multinomial Naive Bayes classifier

Kaur, Wandeep and Balakrishnan, Vimala and Wong, Kok-Seng (2022) Improving multi-label text classification using weighted information gain and co-trained Multinomial Naive Bayes classifier. Malaysian Journal of Computer Science, 35 (1). pp. 21-36. ISSN 0127-9084, DOI

Full text not available from this repository.


Over recent years, the emergence of electronic text processing systems has generated a vast amount of structured and unstructured data, thus creating a challenging situation for users to rummage through irrelevant information. Therefore, studies are continually looking to improve the classification process to produce more accurate results that would benefit users. This paper looks into the weighted information gain method that re-assigns wrongly classified features with new weights to provide better classification. The method focuses on the weights of the frequency bins, assuming every time a certain word frequency bin is iterated, it provides information on the target word feature. Therefore, the more iteration and re-assigning of weight occur within the bin, the more important the bin becomes, eventually providing better classification. The proposed algorithm was trained and tested using a corpus extracted from dedicated Facebook pages related to diabetes. The weighted information gain feature selection technique is then fed into a co-trained Multinomial Naive Bayes classification algorithm that captures the labels' dependencies. The algorithm incorporates class value dependencies since the dataset used multi-label data before converting string vectors that allow the sparse distribution between features to be minimised, thus producing more accurate results. The results of this study show an improvement in classification to 61%.

Item Type: Article
Funders: Universiti Malaya[UMRG RP059C 17SBS]
Uncontrolled Keywords: Text classification;Multi-label;Feature selection;Weighted Information Gain;Multinomial Naive Bayes
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Computer Science & Information Technology
Depositing User: Ms. Juhaida Abd Rahim
Date Deposited: 04 Aug 2022 01:51
Last Modified: 04 Aug 2022 01:51

Actions (login required)

View Item View Item