| Sign In to gain access to subscriptions and/or personal tools. |
A Two-Stage Scoring Method to Enhance Accuracy of Performance Level ClassificationHarvard School of Public Health, mfink{at}jimmy.harvard.edu
University of North Carolina at Greensboro
Measured Progress Many tests classify each examinee into one of multiple performance levels on the basis of a combination of multiple-choice (MC) and constructed-response (CR) items. This study introduces a two-stage scoring method that identifies examinees whose MC scores place them near a cut point, advising scorers on which examinees will be most affected by score discrepancies. The idea that additional attention be given to such examinees' CR responses is explored from both psychometric and practical perspectives. Because more precision is achieved for examinees near the cut points, the method has potential to enhance the percentage of examinees classified correctly. In an empirical investigation of two operational assessments, the two-stage scoring approach successfully predicted which examinees would ultimately attain scores near the border between two performance levels.
Key Words: classification accuracy interrater reliability large-scale assessment score resolution
This version was published on February
1, 2009 Educational and Psychological Measurement, Vol. 69, No. 1,
5-17 (2009) |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||