A N-gram based approach to auto-extracting topics from research articles

Zhu, Linkai and Wang, Wennan and Huang, Maoyi and Chen, Maomao and Wang, Yiyun and Cai, Zhiming (2022) A N-gram based approach to auto-extracting topics from research articles. Journal of Intelligent & Fuzzy Systems, 43 (5). pp. 6137-6146. ISSN 1064-1246, DOI https://doi.org/10.3233/JIFS-220115.

Full text not available from this repository.

Abstract

A lot of manual work goes into identifying a topic for an article. With a large volume of articles, the manual process can be exhausting. Our approach aims to address this issue by automatically extracting topics from the text of large numbers of articles. This approach takes into account the efficiency of the process. Based on existing N-gram analysis, our research examines how often certain words appear in documents in order to support automatic topic extraction. In order to improve efficiency, we apply custom filtering standards to our research. Additionally, delete as many noncritical or irrelevant phrases as possible. In this way, we can ensure we are selecting unique keyphrases for each article, which capture its core idea1. For our research, we chose to center on the autonomous vehicle domain, since the research is relevant to our daily lives. We have to convert the PDF versions of most of the research papers into editable types of files such as TXT. This is because most of the research papers are only in PDF format. To test our proposed idea of automating, numerous articles on robotics have been selected. Next, we evaluate our approach by comparing the result with other models.

Item Type: Article
Funders: FDCT-NSFC [0066/2019/AFJ], Research and Application of Cooperative MultiAgent Platform for Zhuhai-Macao Manufacturing Service(MOST-FDCT) [0058/2019/AMJ], National Key Research and Development Program of China [2020YFB806504]
Uncontrolled Keywords: Automatic topic extraction; Frequency statistic; Keyphrase; N-gram
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Depositing User: Ms. Juhaida Abd Rahim
Date Deposited: 30 Aug 2023 03:09
Last Modified: 30 Aug 2023 03:09
URI: http://eprints.um.edu.my/id/eprint/41023

Actions (login required)

View Item View Item