Shah, Asad Ali and Ravana, Sri Devi and Hamid, Suraya and Ismail, Maizatul Akmar (2019) Accuracy evaluation of methods and techniques in Web-based question answering systems: a survey. Knowledge and Information Systems, 58 (3). pp. 611-650. ISSN 0219-1377, DOI https://doi.org/10.1007/s10115-018-1203-0.
Full text not available from this repository.Abstract
Question answering (QA) systems answer the queries of users efficiently in the least amount of time. A researcher has to decide which among various methods and techniques available will be used to retrieve accurate answers when developing a QA system. This step creates an overhead before making a selection.The study highlights the methods and techniques that perform well in terms of the accuracy of answers provided. Nine Web-based question answering systems were consulted, and the applied methods and techniques evaluated on the basis of the percentage of questions correctly answered and the mean reciprocal rank evaluation measures. Results were discussed using three key stages involved in a QA system: answer extraction, scoring of answers, and answer aggregation. Results show some techniques have higher accuracy of answers than others. Not all methods in QA systems can improve the accuracy of answers individually, but the methods used in combination obtain greater effect. The results can be used to select methods and techniques optimal for producing highly accurate scores without spending time on benchmarking. © 2018, Springer-Verlag London Ltd., part of Springer Nature.
| Item Type: | Article |
|---|---|
| Funders: | UMRG Programme RP059A-17SBS from Universiti Malaya and the Ministry of Higher Education, Malaysia |
| Uncontrolled Keywords: | Answer accuracy; Answer retrieval methods; Information retrieval; Natural language processing; Question answering systems |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Divisions: | Faculty of Languages and Linguistics |
| Depositing User: | Ms. Juhaida Abd Rahim |
| Date Deposited: | 20 Jan 2020 06:46 |
| Last Modified: | 20 Jan 2020 06:46 |
| URI: | http://eprints.um.edu.my/id/eprint/23489 |
Actions (login required)
 |
View Item |
