This Article Full Text (OnlineFirst PDF) All Versions of this Article: 0013164407312603v1 68/4/603    most recent Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Google Scholar Articles by Lee, G. Articles by Lewis, D. M. Social Bookmarking                   What's this?

A Generalizability Theory Approach to Standard Error Estimates for Bookmark Standard Settings

^* To whom correspondence should be addressed. E-mail: guemin{at}yonsei.ac.kr.

	Abstract

The bookmark standard-setting procedure is an item response theory–based method that is widely implemented in state testing programs. This study estimates standard errors for cut scores resulting from bookmark standard settings under a generalizability theory model and investigates the effects of different universes of generalization and error sources on standard errors. This study produced several notable results. First, different patterns of variance component estimates are found for different cut scores; therefore, researchers should estimate separate variance components for each cut score and use them to estimate corresponding standard errors. Second, different universes of generalization produce different standard error estimates; thus, policy makers should consider which universe is appropriate for the proposed use of cut scores. Third, participants and groups have nonnegligible effects on several error sources. To decrease the standard errors for cut scores, increasing the number of small groups seems more efficient than increasing the number of participants.

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?