Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Click here for more information on Research and Evaluation in Education and Psychology, 3e

Click here to sign up for SAGE Journal Email Alerts today!

Sign In to gain access to subscriptions and/or personal tools.
Educational and Psychological Measurement
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Engelhard, G.
Right arrow Articles by Stone, G. E.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Evaluating the Quality of Ratings Obtained from Standard-Seting Judges

George Engelhard, Jr.

Emory University

Gregory E. Stone

Dental Assisting National Board

The purpose of this study is to describe a new approach based on Rasch measurement theory for examining the quality of ratings obtained from standard-setting judges. This new approach is based on the adaptation and modification of several indicators of rating errors. To explore the usefulness of the Rasch measurement theory, the ratings of the nine judges who took part in the standard-setting process on a certification examination for nurses were examined. Ratings were obtained for 213 multiple-choice items on this examination. The data suggest that the judges vary significantly in their views of the essential items required for certification. Furthermore, the data suggest that there is statistically significant variability in the judged essentiality of these items.

Educational and Psychological Measurement, Vol. 58, No. 2, 179-196 (1998)
DOI: 10.1177/0013164498058002003
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Language TestingHome page
E. Schaefer
Rater bias patterns in an EFL writing assessment
Language Testing, October 1, 2008; 25(4): 465 - 493.
[Abstract] [PDF]

Home page
 Eval Health ProfHome page
B. Hess, R. G. Subhiyah, and C. Giordano
Convergence Between Cluster Analysis and the Angoff Method for Setting Minimum Passing Scores on Credentialing Examinations
Eval Health Prof, December 1, 2007; 30(4): 362 - 375.
[Abstract] [PDF]