The value of ranges from -1 to +1.00, whereby a positive K indicates that the observers agree more frequently than expected by chance, zero indicates that both raters agree on the same level as expected by chance, and a negative value indicates that both raters agree less often than expected by chance. A negative K provides a strong hint that raters do not use all categories in the appropriate way. As a rule of thumb, a K of .60 can be regarded as the minimal acceptable level of agreement (Gelfland & Hartmann, 1975), whereas a K of .80 is an indication of good reliability (Landis & Koch, 1977).

Was this article helpful?

0 0

Post a comment