This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Berry, K. J. Articles by Mielke, P. W. Search for Related Content Social Bookmarking                         What's this?

A Generalization of Cohen's Kappa Agreement Measure to Interval Measurement and Multiple Raters

Colorado State University, Fort Collins

Paul W. Mielke, Jr.

Colorado State University, Fort Collins

Cohen's kappa statistic is frequently used to measure agreement between two observers employing categorical polytomies. In this paper, Cohen's statistic is shown to be inherently multivariate in nature; it is expanded to analyze ordinal and interval data; and it is extended to more than two observers. A nonasymptotic test of significance is provided for the generalized statistic.

Educational and Psychological Measurement, Vol. 48, No. 4, 921-933 (1988)
DOI: 10.1177/0013164488484007


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				R. D. Brown and N. M. A. Hauenstein Interrater Agreement Reconsidered: An Alternative to the rwg Indices Organizational Research Methods, April 1, 2005; 8(2): 165 - 184. [Abstract] [PDF]

				C. Neitzel and A. D. Stright Parenting behaviours during child problem solving: The roles of child temperament, mother education and personality, and the problem-solving context International Journal of Behavioral Development, March 1, 2004; 28(2): 166 - 179. [Abstract] [PDF]

				H. Janson and U. Olsson A Measure of Agreement for Interval or Nominal Multivariate Observations by Different Sets of Judges Educational and Psychological Measurement, February 1, 2004; 64(1): 62 - 70. [Abstract] [PDF]

				A. D. Stright and C. Neitzel Beyond parenting: Coparenting and children's classroom adjustment International Journal of Behavioral Development, January 1, 2003; 27(1): 31 - 40. [Abstract] [PDF]

				H. Janson and U. Olsson A Measure of Agreement for Interval or Nominal Multivariate Observations Educational and Psychological Measurement, April 1, 2001; 61(2): 277 - 289. [Abstract] [PDF]

				K. J. Berry and P. W Mielke JR. Computer Studies Measuring the Joint Agreement between Multiple Raters and a Standard Educational and Psychological Measurement, June 1, 1997; 57(3): 527 - 530. [Abstract]

				J. E. Workman and E. W. Freeburg A Method to Identify Occupational Stereotypes Family and Consumer Sciences Research Journal, June 1, 1997; 25(4): 390 - 411. [Abstract]

				K. J. Berry and P. W. Mielke JR. Agreement Measure Comparisons between Two Independent Sets of Raters Educational and Psychological Measurement, April 1, 1997; 57(2): 360 - 364. [Abstract]

				K. J. Berry and P. W. Mielke JR. A Measure of Association for Nominal Independent Variables Educational and Psychological Measurement, December 1, 1992; 52(4): 895 - 898. [Abstract]

				M. B. Goldstein and M. A. Bokoros Tilting at Windmills: Comparing the Learning Style Inventory and the Learning Style Questionnaire Educational and Psychological Measurement, September 1, 1992; 52(3): 701 - 708. [Abstract]

				L. D. Goodwin, D. J. Sands, and E. B. Kozleski Estimating Interinterviewer Reliability for Interview Schedules used in Special Education Research Journal of Special Education, January 1, 1991; 25(1): 73 - 89. [Abstract] [PDF]

				K. J. Berry and P. W. Mielke Jr. A Generalized Agreement Measure Educational and Psychological Measurement, March 1, 1990; 50(1): 123 - 125. [Abstract]