This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Stone, C. A. Search for Related Content Social Bookmarking                         What's this?

Empirical Power and Type I Error Rates for an IRT Fit Statistic that Considers the Precision of Ability Estimates

University of Pittsburgh, cas+{at}pitt.edu

Model-data-fit of item response theory (IRT) models is generally assessed by comparing observed performance by examinees on individual items with performance that is predicted under the chosen IRT model. However, use of traditional chi-square methods to evaluate goodness-of-fit of IRT models is not appropriate when the underlying trait/ability is estimated imprecisely (e.g., shorter assessments). This article describes a goodness-of-fit statistic that considers directly the uncertainty with which ability is estimated as well as a resampling-based hypothesis testing procedure. A simulation study was conducted to evaluate the empirical power and Type I error rates for the proposed procedure. Results of the study indicated that the procedure should be useful for evaluating goodness-of-fit of IRT models for most testing applications where uncertainty in ability estimation is an issue.

Key Words: goodness-of-fit • IRT • posterior probabilities • performance assessments

Educational and Psychological Measurement, Vol. 63, No. 4, 566-583 (2003)
DOI: 10.1177/0013164402251034


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				F. J. Abad, J. Olea, and V. Ponsoda The Multiple-Choice Model: Some Solutions for Estimation of Parameters in the Presence of Omitted Responses Applied Psychological Measurement, May 1, 2009; 33(3): 200 - 221. [Abstract] [PDF]

				Bo Zhang and C. A. Stone Evaluating Item Fit for Multidimensional Item Response Models Educational and Psychological Measurement, April 1, 2008; 68(2): 181 - 196. [Abstract] [PDF]

				C. E. Demars Type I Error Rates for Parscale's Fit Index Educational and Psychological Measurement, February 1, 2005; 65(1): 42 - 50. [Abstract] [PDF]

				C. A. Stone IRTFIT-RESAMPLE: A Computer Program for Assessing Goodness of Fit of Item Response Theory Models Based on Posterior Expectations Applied Psychological Measurement, March 1, 2004; 28(2): 143 - 144. [PDF]

				C. E. DeMars Type I Error Rates for Generalized Graded Unfolding Model Fit Indices Applied Psychological Measurement, January 1, 2004; 28(1): 48 - 71. [Abstract] [PDF]