This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Simon, P. Search for Related Content Social Bookmarking                         What's this?

Including Omission Mistakes in the Calculation of Cohen's Kappa and an Analysis of the Coefficient's Paradox Features

University of Regensburg

The application range of Cohen's Kappa is extended to the field of sequential observation data, where omission mistakes of an observer may often occur. It is shown how the omission mistakes can be incorporated into the calculation of the Kappa coefficient without violating the statistic it is based on. The enhanced coefficient is termed Kappa Coefficient With Omission Calculation (K_woc). In addition, the so-called paradox features of the Kappa coefficient, the base-rate problem, and the observer bias are discussed. It is shown that, in the case of observation data, these attributes are desirable features of the Kappa coefficient.

Key Words: sequential observation • omission mistakes • Kappa coefficient • base-rate problem • observer bias

Educational and Psychological Measurement, Vol. 66, No. 5, 765-777 (2006)
DOI: 10.1177/0013164405285548


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				H. De Vries, M. N. Elliott, D. E. Kanouse, and S. S. Teleki Using Pooled Kappa to Summarize Interrater Agreement across Many Items Field Methods, August 1, 2008; 20(3): 272 - 282. [Abstract] [PDF]