Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Click here to submit your manuscript to SPPS

Click here for more information on Research and Evaluation in Education and Psychology, 3e

Sign In to gain access to subscriptions and/or personal tools.
Educational and Psychological Measurement
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Fehrmann, M. L.
Right arrow Articles by Arthur, W.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

The Angoff Cutoff Score Method: The Impact of Frame-of-Reference Rater Training

Melinda L. Fehrmann

Texas A&M University

David J. Woehr

Texas A&M University

Winfred Arthur, Jr.

Texas A&M University

One of the most preferred and widely used methods for generating cutoff scores in content-related validity situations is the Angoff procedure. This procedure, however, typically displays low inter-rater reliability. Very little is known about the accuracy of the cutoff scores. The present study compares the effect of two frame-of-reference rater training approaches on the reliability and accuracy of cutoff scores generated by the Angoff procedure. Results indicate that both frame-of-reference rater training strategies resulted in significantly higher levels of interrater reliability and more accurate decisions than a non-frame-of-reference condition.

Educational and Psychological Measurement, Vol. 51, No. 4, 857-872 (1991)
DOI: 10.1177/001316449105100406
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Educational and Psychological MeasurementHome page
G. M. Hurtz and M. A. Auerbach
A Meta-Analysis of the Effects of Modifications to the Angoff Method on Cutoff Scores and Judgment Consensus
Educational and Psychological Measurement, August 1, 2003; 63(4): 584 - 601.
[Abstract] [PDF]

Home page
 Educational and Psychological MeasurementHome page
G. M. Hurtz and N. R. Hertz
How Many Raters Should be Used for Establishing Cutoff Scores with the Angoff Method? a Generalizability Theory Study
Educational and Psychological Measurement, December 1, 1999; 59(6): 885 - 897.
[Abstract] [PDF]