Accuracy evaluation of methods and techniques in Web-based question answering systems: a survey

Shah, Asad Ali and Ravana, Sri Devi and Hamid, Suraya and Ismail, Maizatul Akmar (2019) Accuracy evaluation of methods and techniques in Web-based question answering systems: a survey. Knowledge and Information Systems, 58 (3). pp. 611-650. ISSN 0219-1377, DOI

Full text not available from this repository.
Official URL:


Question answering (QA) systems answer the queries of users efficiently in the least amount of time. A researcher has to decide which among various methods and techniques available will be used to retrieve accurate answers when developing a QA system. This step creates an overhead before making a selection.The study highlights the methods and techniques that perform well in terms of the accuracy of answers provided. Nine Web-based question answering systems were consulted, and the applied methods and techniques evaluated on the basis of the percentage of questions correctly answered and the mean reciprocal rank evaluation measures. Results were discussed using three key stages involved in a QA system: answer extraction, scoring of answers, and answer aggregation. Results show some techniques have higher accuracy of answers than others. Not all methods in QA systems can improve the accuracy of answers individually, but the methods used in combination obtain greater effect. The results can be used to select methods and techniques optimal for producing highly accurate scores without spending time on benchmarking. © 2018, Springer-Verlag London Ltd., part of Springer Nature.

Item Type: Article
Funders: UMRG Programme RP059A-17SBS from Universiti Malaya and the Ministry of Higher Education, Malaysia
Uncontrolled Keywords: Answer accuracy; Answer retrieval methods; Information retrieval; Natural language processing; Question answering systems
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Languages and Linguistics
Depositing User: Ms. Juhaida Abd Rahim
Date Deposited: 20 Jan 2020 06:46
Last Modified: 20 Jan 2020 06:46

Actions (login required)

View Item View Item