This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Abedi, J. Articles by Baker, E. L. Search for Related Content Social Bookmarking                         What's this?

A Latent-Variable Modeling Approach Toassessing Interrater Reliability, Topic Generalizability, and Validity of a Content Assessment Scoring Rubric

University of California, Los Angeles

Eva L. Baker

University of California, Los Angeles

This article describes the limitations of certain statistical techniques and approaches for handling multiple criteria in assessing reliability, concurrent validity, and generalizability. The article also suggests alternatives to using these approaches on performance assessment measures. The application of the latent variable modeling approach to the data revealed a significant improvement in the degree of interrater reliability, concurrent validity, and generalizability (over raters and topics) on a scoring rubric. The improvement in concurrent validity was particularly noticeable. However, it should be noted that one of the main limitations of this study was the use of a small number of subjects, which could have affected the validity of some of the findings.

Educational and Psychological Measurement, Vol. 55, No. 5, 701-715 (1995)
DOI: 10.1177/0013164495055005001


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?