This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by De Ayala, R. J. Search for Related Content Social Bookmarking                         What's this?

A Comparison of the Nominal Response Model and the Three-Parameter Logistic Model in Computerized Adaptive Testing

University of Maryland

It is intuitive to presume that when an examinee incorrectly answers a test item that he or she may possess partial knowledge of the item's correct answer. However, current use of dichotomous item response theory (IRT) models in IRT-based computerized adaptive testing (CAT) ignore this partial information in their ability estimation. In this study a (polychotomous) nominal response model-based CAT (NR CAT) was simulated using an empirical data set. The ability estimation of NR CAT as well as its overall performance was compared to that of a dichotomous three-parameter logistic model-based CAT (3PL CAT). Results showed that the NR CAT's ability estimates were highly correlated with an external criterion and with those of the 3PL CAT. Both CATs showed only a slight bias in their ability estimates for that region of the ability continuum where their respective model did not provide a great deal of information. Despite the positively skewed information function afforded by the nominal response model the NR CAT was able to provide relatively accurate ability estimates in the upper 6 range, and its convergence rate was superior to that of the 3PL CAT. The implications of a nominal response model-based CAT are discussed.

Educational and Psychological Measurement, Vol. 49, No. 4, 789-805 (1989)
DOI: 10.1177/001316448904900403


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				L. Yao and R. D. Schwarz A Multidimensional Partial Credit Model With Associated Item and Test Statistics: An Application to Mixed-Format Tests Applied Psychological Measurement, November 1, 2006; 30(6): 469 - 492. [Abstract] [PDF]

				C. A. McHorney Ten Recommendations for Advancing Patient-Centered Outcomes Measurement for Older Persons Ann Intern Med, September 2, 2003; 139(5_Part_2): 403 - 409. [Abstract] [Full Text] [PDF]

				S.-K. Chen, L. Hou, and B. G. Dodd A Comparison of Maximum Likelihood Estimation and Expected a Posteriori Estimation in CAT Using the Partial Credit Model Educational and Psychological Measurement, August 1, 1998; 58(4): 569 - 595. [Abstract]

				S.-K. Chen, L. Hou, S. J. Fitzpatrick, and B. G. Dodd The Effect of Population Distribution and Method of Theta Estimation on Computerized Adaptive Testing (CAT) Using the Rating Scale Model Educational and Psychological Measurement, June 1, 1997; 57(3): 422 - 439. [Abstract]

				B. G. Dodd, R.J. De Ayala, and W. R. Koch Computerized Adaptive Testing With Polytomous Items Applied Psychological Measurement, March 1, 1995; 19(1): 5 - 22.