This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Vacha-Haase, T. Articles by Caruso, J. C. Search for Related Content Social Bookmarking                         What's this?

Reliability Generalization: Moving toward Improved Understanding and Use of Score Reliability

Colorado State Universitytvh{at}lamar.colostate.edu

Robin K. Henson

University of North Texasrhenson{at}unt.edu

John C. Caruso

University of Montanajcaruso{at}selway.umt.edu

Reliability generalization (RG) is a measurement meta-analytic method used to explore the variability in score reliability estimates and to characterize the possible sources of this variance. This article briefly summarizes some RG considerations. Included is a description of how reliability confidence intervals might be portrayed graphically. The article includes tabulations across various RG studies, including how frequently authors (a) report score reliabilities for their own data, (b) conduct reliability induction, or (c) do not even mention reliability.

Educational and Psychological Measurement, Vol. 62, No. 4, 562-569 (2002)
DOI: 10.1177/0013164402062004002


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				K. L. Slaney, M. Tkatchouk, S. M. Gabriel, and M. D. Maraun Psychometric Assessment and Reporting Practices: Incongruence Between Theory and Practice Journal of Psychoeducational Assessment, December 1, 2009; 27(6): 465 - 476. [Abstract] [PDF]

				S. J. Marshall, D. L. Wodrich, and J. S. Gorin Development of the Tempe Sorting Task: A Principled Approach to Assessment of Children's Executive Functioning Educational and Psychological Measurement, August 1, 2009; 69(4): 655 - 674. [Abstract] [PDF]

				J. L. Romano and J. D. Kromrey What Are the Consequences If the Assumption of Independent Observations Is Violated in Reliability Generalization Meta-Analysis Studies? Educational and Psychological Measurement, June 1, 2009; 69(3): 404 - 428. [Abstract] [PDF]

				Q.-L. Huynh, R. T. Howell, and V. Benet-Martinez Reliability of Bidimensional Acculturation Scores: A Meta-Analysis Journal of Cross-Cultural Psychology, March 1, 2009; 40(2): 256 - 274. [Abstract] [PDF]

				M. Vassar and W. Hale Reliability Reporting Across Studies Using the Buss Durkee Hostility Inventory J Interpers Violence, January 1, 2009; 24(1): 20 - 37. [Abstract] [PDF]

				K. R. Rexrode, S. Petersen, and S. O'Toole The Ways of Coping Scale: A Reliability Generalization Study Educational and Psychological Measurement, April 1, 2008; 68(2): 262 - 280. [Abstract] [PDF]

				S. N. Beretvas, M.-A. Suizzo, J. A. Durham, and L. M. Yarnell A Reliability Generalization Study of Scores on Rotter's and Nowicki-Strickland's Locus of Control Scales Educational and Psychological Measurement, February 1, 2008; 68(1): 97 - 119. [Abstract] [PDF]

				R. T. Howell and A. L. Shields The File Drawer Problem in Reliability Generalization: A Strategy to Compute a Fail-Safe N With Reliability Coefficients Educational and Psychological Measurement, February 1, 2008; 68(1): 120 - 128. [Abstract] [PDF]

				C. S. Miller, A. L. Shields, D. Campfield, K. A. Wallace, and R. D. Weiss Substance Use Scales of the Minnesota Multiphasic Personality Inventory: An Exploration of Score Reliability Via Meta-Analysis Educational and Psychological Measurement, December 1, 2007; 67(6): 1052 - 1065. [Abstract] [PDF]

				R. I. Lanyon and A. C. Carle Internal and External Validity of Scores on the Balanced Inventory of Desirable Responding and the Paulhus Deception Scales Educational and Psychological Measurement, October 1, 2007; 67(5): 859 - 876. [Abstract] [PDF]

				L. L. Thomas, N. R. Kuncel, and M. Crede Noncognitive Variables in College Admissions: The Case of the Non-Cognitive Questionnaire Educational and Psychological Measurement, August 1, 2007; 67(4): 635 - 657. [Abstract] [PDF]

				F. C. Worrell and Z. R. Mello The Reliability and Validity of Zimbardo Time Perspective Inventory Scores in Academically Talented Adolescents Educational and Psychological Measurement, June 1, 2007; 67(3): 487 - 504. [Abstract] [PDF]

				A. Li and J. Bagger The Balanced Inventory of Desirable Responding (BIDR): A Reliability Generalization Study Educational and Psychological Measurement, June 1, 2007; 67(3): 525 - 544. [Abstract] [PDF]

				C. M. Hellman, D. R. Fuqua, and J. Worley A Reliability Generalization Study on the Survey of Perceived Organizational Support: The Effects of Mean Age and Number of Items on Score Reliability Educational and Psychological Measurement, August 1, 2006; 66(4): 631 - 642. [Abstract] [PDF]

				L. S. Feldt and R. A. Charter Averaging Internal Consistency Reliability Coefficients Educational and Psychological Measurement, April 1, 2006; 66(2): 215 - 227. [Abstract] [PDF]

				L. F. Leach, R. K. Henson, L. R. Odom, and L. S. Cagle A Reliability Generalization Study of the Self-Description Questionnaire Educational and Psychological Measurement, April 1, 2006; 66(2): 285 - 304. [Abstract] [PDF]

				C. T. Bruckner, P. J. Yoder, and R.A. McWilliam Generalizability and Decision Studies: An Example Using Conversational Language Samples Journal of Early Intervention, January 1, 2006; 28(2): 139 - 153. [Abstract] [PDF]

				R. J. De Ayala, D. J. Vonderharr-Carlson, and D. Kim Assessing the Reliability of the Beck Anxiety Inventory Scores Educational and Psychological Measurement, October 1, 2005; 65(5): 742 - 756. [Abstract] [PDF]

				J. S. Campbell, S. Pulos, M. Hogan, and F. Murry Reliability Generalization of the Psychopathy Checklist Applied in Youthful Samples Educational and Psychological Measurement, August 1, 2005; 65(4): 639 - 656. [Abstract] [PDF]

				M. E. Ross, M. Blackburn, and S. Forbes Reliability Generalization of the Patterns of Adaptive Learning Survey Goal Orientation Scales Educational and Psychological Measurement, June 1, 2005; 65(3): 451 - 464. [Abstract] [PDF]

				D. J. Ryngala, A. L. Shields, and J. C. Caruso Reliability Generalization of the Revised Children's Manifest Anxiety Scale Educational and Psychological Measurement, April 1, 2005; 65(2): 259 - 271. [Abstract] [PDF]

				T. C. Campbell An Introduction to Clinical Significance: An Alternative Index of Intervention Effect for Group Experimental Designs Journal of Early Intervention, April 1, 2005; 27(3): 210 - 227. [Abstract] [PDF]

				A. L. Shields and J. C. Caruso A Reliability Induction and Reliability Generalization Study of the Cage Questionnaire Educational and Psychological Measurement, April 1, 2004; 64(2): 254 - 270. [Abstract] [PDF]

				X. Fan Two Approaches for Correcting Correlation Attenuation Caused by Measurement Error: Implications for Research Practice Educational and Psychological Measurement, December 1, 2003; 63(6): 915 - 930. [Abstract] [PDF]

				X. Fan and P. Yin Examinee Characteristics and Score Reliability: An Empirical Investigation Educational and Psychological Measurement, June 1, 2003; 63(3): 357 - 368. [Abstract] [PDF]

				P. Snyder, B. Thompson, M. E. Mclean, and B. J. Smith Examination of Quantitative Methods Used in Early Intervention Research: Linkages With Recommended Practices Journal of Early Intervention, January 1, 2002; 25(2): 137 - 150. [Abstract] [PDF]