Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

CiteULike is a free service for managing and discovering scholarly references - click here to get started.

Sign In to gain access to subscriptions and/or personal tools.
Educational and Psychological Measurement
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Janson, H.
Right arrow Articles by Olsson, U.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

A Measure of Agreement for Interval or Nominal Multivariate Observations

Harald Janson

Stockholm Universityharald.janson{at}r-bup.no

Ulf Olsson

Swedish University of Agricultural Sciences

This article addresses the problem of accounting overall chance-corrected interobserver agreement among the multivariate ratings of several judges. Modifying an approach by Berry and Mielke, a generalization of Cohen’s kappa coefficient is proposed. The generalized statistic accounts agreement for multivariate interval or nominal observations among several judges. The statistic’s metric is conventional, and in the univariate case it is equivalent to existing extensions of the kappa coefficient to several observers, as well as to a certain intraclass correlation coefficient. Application is exemplified using hypothetical and real-life data sets.

Educational and Psychological Measurement, Vol. 61, No. 2, 277-289 (2001)
DOI: 10.1177/00131640121971239
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Am. J. Roentgenol.Home page
M. M. Lell, C. Gmelin, C. Panknin, K. T. Eckel, M. Schmid, W. A. Bautz, and H. Greess
Thin-Slice MDCT of the Neck: Impact on Cancer Staging
Am. J. Roentgenol., March 1, 2008; 190(3): 785 - 789.
[Abstract] [Full Text] [PDF]

Home page
 Human Factors: The Journal of the Human Factors and Ergonomics SocietyHome page
M. L. Ebersole and T. J. Armstrong
Analysis of an Observational Rating Scale for Repetition, Posture, and Force in Selected Manufacturing Settings
Human Factors: The Journal of the Human Factors and Ergonomics Society, January 1, 2006; 48(3): 487 - 498.
[Abstract] [PDF]

Home page
 Organizational Research MethodsHome page
R. D. Brown and N. M. A. Hauenstein
Interrater Agreement Reconsidered: An Alternative to the rwg Indices
Organizational Research Methods, April 1, 2005; 8(2): 165 - 184.
[Abstract] [PDF]

Home page
 Educational and Psychological MeasurementHome page
H. Janson and U. Olsson
A Measure of Agreement for Interval or Nominal Multivariate Observations by Different Sets of Judges
Educational and Psychological Measurement, February 1, 2004; 64(1): 62 - 70.
[Abstract] [PDF]