A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables

Zaki, R. and Bulgiba, A. and Nordin, N. and Ismail, N.A. (2013) A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables. Iranian Journal of Basic Medical Sciences, 16 (6). pp. 803-807. ISSN 2008-3866,

Preview

PDF PMC3758037.pdf - Published Version Download (411kB)

Abstract

Objective(s): Reliability measures precision or the extent to which test results can be replicated. This is the first ever systematic review to identify statistical methods used to measure reliability of equipment measuring continuous variables. This studyalso aims to highlight the inappropriate statistical method used in the reliability analysis and its implication in the medical practice. Materials and Methods: In 2010, five electronic databases were searched between 2007 and 2009 to look for reliability studies. A total of 5,795 titles were initially identified. Only 282 titles were potentially related, and finally 42 fitted the inclusion criteria. Results: The Intra-class Correlation Coefficient (ICC) is the most popular method with 25 (60) studies having used this method followed by the comparing means (8 or 19). Out of 25 studies using the ICC, only 7 (28) reported the confidence intervals and types of ICC used. Most studies (71) also tested the agreement of instruments. Conclusion: This study finds that the Intra-class Correlation Coefficient is the most popular method used to assess the reliability of medical instruments measuring continuous outcomes. There are also inappropriate applications and interpretations of statistical methods in some studies. It is important for medical researchers to be aware of this issue, and be able to correctly perform analysis in reliability studies.

Item Type:	Article
Funders:	UNSPECIFIED
Uncontrolled Keywords:	ICC, Intra-class correlation coefficient, Reliability, Statistical method, Validation study
Subjects:	R Medicine
Divisions:	Faculty of Medicine
Depositing User:	Ms Haslinda Lahuddin
Date Deposited:	15 Apr 2014 08:07
Last Modified:	15 Apr 2014 08:07
URI:	http://eprints.um.edu.my/id/eprint/9840

Actions (login required)

View Item