This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Ferdous, A. A. Articles by Plake, B. S. Search for Related Content Social Bookmarking                         What's this?

Item Selection Strategy for Reducing the Number of Items Rated in an Angoff Standard Setting Study

Measured Progress, Dover, New Hampshire, aferdous{at}measuredprogress.org.

Barbara S. Plake

University of Nebraska—Lincoln

In an Angoff standard setting procedure, judges estimate the probability that a hypothetical randomly selected minimally competent candidate will answer correctly each item in the test. In many cases, these item performance estimates are made twice, with information shared with the panelists between estimates. Especially for long tests, this estimation process can be time-consuming and fatiguing for the judges. This study extended an item selection strategy earlier proposed to form subsets of test items. The results of this study suggest that 40% to 50% of test items may be sufficient to estimate an equivalent passing score in an Angoff setting study when those items are selected to represent the full test in content, discrimination, and difficulty.

Key Words: standard setting • minimum passing score • Angoff method • subsets of test items • stratified item selection

Educational and Psychological Measurement, Vol. 67, No. 2, 193-206 (2007)
DOI: 10.1177/0013164406288160


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?