This Article Full Text (PDF) All Versions of this Article: 0013164407307007v1 68/2/215    most recent References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Lee, Y.-H. Articles by Fuh, C.-D. Search for Related Content Social Bookmarking                         What's this?

A Strategy for Controlling Item Exposure in Multidimensional Computerized Adaptive Testing

Columbia University

Edward H. Ip

Wake Forest University

Cheng-Der Fuh

National Central University and Academia Sinica

Although computerized adaptive tests have enjoyed tremendous growth, solutions for important problems remain unavailable. One problem is the control of item exposure rate. Because adaptive algorithms are designed to select optimal items, they choose items with high discriminating power. Thus, these items are selected more often than others, leading to both overexposure and underutilization of some parts of the item pool. Overused items are often compromised, creating a security problem that could threaten the validity of a test. Building on a previously proposed stratification scheme to control the exposure rate for one-dimensional tests, the authors extend their method to multidimensional tests. A strategy is proposed based on stratification in accordance with a functional of the vector of the discrimination parameter, which can be implemented with minimal computational overhead. Both theoretical and empirical validation studies are provided. Empirical results indicate significant improvement over the commonly used method of controlling exposure rate that requires only a reasonable sacrifice in efficiency.

Key Words: item response theory • computerized adaptive testing • discrimination parameter • D-optimality • maximum likelihood estimate • test security

This version was published on April 1, 2008

Educational and Psychological Measurement, Vol. 68, No. 2, 215-232 (2008)
DOI: 10.1177/0013164407307007


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?