| Journal
of Agricultural, Biological, and Environmental Statistics A journal of applied statistics. Published by the American Statistical Association and the International Biometric Society. |
The purpose of this article is to define a single descriptive measure of agreement that provides insight into the question: Does an autonomous computer algorithm dedicated to a measurement task perform better or worse than trained observers relative to a continuous gold standard measurement? We have defined a new measure t, 0 £ t £ 1, called the relative agreement, which measures the relative distance between three measurements from three distinct raters to the line of equality or agreement (i.e., the 45o line passing through the origin). We will illustrate that t is independent of the correlation coefficient or other measures of association or location that are commonly misused or misinterpreted as measures of agreement. An example of the relative agreement t is given to an echocardiographic imaging (EI) study. The goal of the EI study is directed toward fully autonomous boundary detection of the epicardial and endocardial surfaces to provide consistent measures of chamber diameter, chamber area, fractional area change, and left ventricular myocardial area.
Key Words
Concordance; Intra-class correlation coefficient; Reliability.
Alan D. Hutson is Research Assistant Professor, University of Florida, Division of Biostatistics, Health Science Center, P.O. Box 100212, Gainesville, FL 32610-0212. David C. Wilson is Professor of Mathematics, University of Florida, Department of Mathematics, 358 Little Hall, Gainesville, FL 32611. Edward A. Geiser is Professor of Medicine, University of Florida, Division of Cardiology, P.O. Box 100277, Gainesville, FL 32610-0277.
Copyright © 1998 American Statistical Association and the International Biometric Society. All rights reserved.