Tamil Offensive Language Detection: Supervised versus Unsupervised Learning Approaches

Balakrishnan, Vimala and Govindan, Vithyatheri and Govaichelvan, Kumanan N. (2023) Tamil Offensive Language Detection: Supervised versus Unsupervised Learning Approaches. ACM Transactions on Asian and Low-Resource Language Information Processing, 22 (4). ISSN 2375-4699, DOI https://doi.org/10.1145/3575860.

Full text not available from this repository.

Abstract

Studies on natural language processing are mainly conducted in English, with very few exploring languages that are under-resourced, including the Dravidian languages. We present a novel work in detecting offensive language using a corpus collected from YouTube containing comments in Tamil. The study specifically aims to compare two machine learning approaches-namely, supervised and unsupervised-to detect offensive patterns in textual communications. In the first setup, offensive language detection models were developed using traditional machine learning algorithms such as Random Forest, Logistic Regression, Support Vector Machine, and AdaBoost, and assessed based on human labeling. Conversely, we used K-means (K = 2) to cluster the unlabeled data before training the same set of machine learning algorithms to detect offensive communications. Performance scores indicate unsupervised clustering to be more effective than human labeling with ensemble classifiers achieving an impressive accuracy of 99.70% and 99.87% respectively for balanced and imbalanced datasets, hence showing that the unsupervised approach can be used effectively to detect offensive language in low-resourced languages.

Item Type: Article
Funders: UNSPECIFIED
Uncontrolled Keywords: Offensive language; Dravidian; Tamil; machine learning; social media
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Computer Science & Information Technology
Depositing User: Ms. Juhaida Abd Rahim
Date Deposited: 22 Jul 2025 01:59
Last Modified: 22 Jul 2025 01:59
URI: http://eprints.um.edu.my/id/eprint/50831

Actions (login required)

View Item View Item