This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Andrew, B. J. Articles by Hecht, J. T. Search for Related Content Social Bookmarking                         What's this?

A Preliminary Investigation of Two Procedures for Setting Examination Standards

National Board of Medical Examiners

James T. Hecht

National Board of Medical Examiners

Two standard setting procedures were employed by two groups of judges to set pass-fail levels for comparable samples of a nationally administered examination. These procedures were both designed to set standards in relation to the minimally qualified examinee. The study was undertaken to determine whether similar standards would be set for the same examination content when determined by different groups of judges, and whether the two procedures employed would result in similar standards for comparable samples of test content. In addition, the extent to which group consensus judgments might differ from individual judgments was also investigated. The results suggest that different groups of judges do set similar examination standards when using the same procedure, and that the average of individual judgments does not differ significantly from group consensus judgments. Significant differences were found, however, between the standards set by the two procedures employed. This finding was observed for both groups. The nature of these differences is described, and their implications for setting examination standards are discussed.

Educational and Psychological Measurement, Vol. 36, No. 1, 45-50 (1976)
DOI: 10.1177/001316447603600105


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				M. Kane Validating the Performance Standards Associated With Passing Scores Review of Educational Research, January 1, 1994; 64(3): 425 - 461. [Abstract] [PDF]

				R. R. Reilly, D. L. Zink, and E. W. Israelski Comparison of Direct and Indirect Methods For Setting Minimum Passing Scores Applied Psychological Measurement, September 1, 1984; 8(4): 421 - 429. [Abstract]

				M. Kane and J. Wilson Errors of Measurement and Standard Setting in Mastery Testing Applied Psychological Measurement, January 1, 1984; 8(1): 107 - 115. [Abstract]

				P.H. Harasym A Comparison of the Nedelsky and Modified Angoff Standard-Setting Procedure On Evaluation Outcome Educational and Psychological Measurement, October 1, 1981; 41(3): 725 - 734. [Abstract]

				S. A. Livingston Comments on Criterion-Referenced Testing Applied Psychological Measurement, October 1, 1980; 4(4): 575 - 581.

				R. L. Brennan and R. E. Lockwood A Comparison of the Nedelsky and Angoff Cutting Score Procedures Using Generalizability Theory Applied Psychological Measurement, April 1, 1980; 4(2): 219 - 240. [Abstract]