Improving retrieval relevance using users’ explicit feedback

Balakrishnan, Vimala and Ahmadi, K. and Ravana, S.D. (2016) Improving retrieval relevance using users’ explicit feedback. Aslib Journal of Information Management, 68 (1). pp. 76-98. ISSN 2050-3806, DOI https://doi.org/10.1108/AJIM-07-2015-0106.

Full text not available from this repository.
Official URL: https://doi.org/10.1108/AJIM-07-2015-0106

Abstract

Purpose – The purpose of this paper is to improve users’ search results relevancy by manipulating their explicit feedback. Design/methodology/approach – CoRRe – an explicit feedback model integrating three popular feedback, namely, Comment-Rating-Referral is proposed in this study. The model is further enhanced using case-based reasoning in retrieving the top-5 results. A search engine prototype was developed using Text REtrieval Conference as the document collection, and results were evaluated at three levels (i.e. top-5, 10 and 15). A user evaluation involving 28 students was administered, focussing on 20 queries. Findings – Both Mean Average Precision and Normalized Discounted Cumulative Gain results indicate CoRRe to have the highest retrieval precisions at all the three levels compared to the other feedback models. Furthermore, independent t-tests showed the precision differences to be significant. Rating was found to be the most popular technique among the participants, producing the best precision compared to referral and comments. Research limitations/implications – The findings suggest that search retrieval relevance can be significantly improved when users’ explicit feedback are integrated, therefore web-based systems should find ways to manipulate users’ feedback to provide better recommendations or search results to the users. Originality/value – The study is novel in the sense that users’ comment, rating and referral were taken into consideration to improve their overall search experience.

Item Type: Article
Funders: UNSPECIFIED
Uncontrolled Keywords: Rating; Referral; Case-based reasoning; Comment; Explicit feedback; Retrieval relevance
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Computer Science & Information Technology
Depositing User: Ms. Juhaida Abd Rahim
Date Deposited: 05 Dec 2017 04:28
Last Modified: 08 Jan 2020 07:41
URI: http://eprints.um.edu.my/id/eprint/18451

Actions (login required)

View Item View Item