This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Fan, X. Articles by Thompson, B. Search for Related Content Social Bookmarking                         What's this?

Confidence Intervals for Effect Sizes

Confidence Intervals about Score Reliability Coefficients, Please: An EPM Guidelines Editorial

University of Virginia

Bruce Thompson

Texas A&M University

Confidence intervals for reliability coefficients can be estimated in various ways. The present article illustrates a variety of these applications. This guidelines editorial also promulgates a request that EPM authors report confidence intervals for reliability estimates whenever they report score reliabilities and note what interval estimation methods they have used. This will reinforce reader understanding that all statistical estimates, including those for score reliability, are affected by sampling error variance. And these requirements may also facilitate understanding that tests are not impregnated with invariant reliability as a routine part of printing.

Educational and Psychological Measurement, Vol. 61, No. 4, 517-531 (2001)
DOI: 10.1177/0013164401614001


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				H. Hulpia, G. Devos, and Y. Rosseel Development and Validation of Scores on the Distributed Leadership Inventory Educational and Psychological Measurement, December 1, 2009; 69(6): 1013 - 1034. [Abstract] [PDF]

				Y. C. Aydin and E. Uzuntiryaki Development and Psychometric Evaluation of the High School Chemistry Self-Efficacy Scale Educational and Psychological Measurement, October 1, 2009; 69(5): 868 - 880. [Abstract] [PDF]

				P.-W. Lei, Q. Wu, J. C. DiPerna, and P. L. Morgan Developing Short Forms of the EARLI Numeracy Measures: Comparison of Item Selection Methods Educational and Psychological Measurement, October 1, 2009; 69(5): 825 - 842. [Abstract] [PDF]

				A. J. Arce-Ferrer and E. Martinez Guzman Studying the Equivalence of Computer-Delivered and Paper-Based Administrations of the Raven Standard Progressive Matrices Test Educational and Psychological Measurement, October 1, 2009; 69(5): 855 - 867. [Abstract] [PDF]

				G. Bjornebekk Psychometric Properties of the Scores on the Behavioral Inhibition and Activation Scales in a Sample of Norwegian Children Educational and Psychological Measurement, August 1, 2009; 69(4): 636 - 654. [Abstract] [PDF]

				J. K. Mitchelson, E. W. Wicher, J. M. LeBreton, and S. B. Craig Gender and Ethnicity Differences on the Abridged Big Five Circumplex (AB5C) of Personality Traits: A Differential Item Functioning Analysis Educational and Psychological Measurement, August 1, 2009; 69(4): 613 - 635. [Abstract] [PDF]

				K. Han, G. N. Burns, N. C. Weed, G. T. Hatchett, and N. K. S. Kurokawa Evaluation of an Observer Form of the Coping Inventory for Stressful Situations Educational and Psychological Measurement, August 1, 2009; 69(4): 675 - 695. [Abstract] [PDF]

				M. N. Bing, S. M. Stewart, and H. K. Davison An Investigation of Calculator Use on Employment Tests of Mathematical Ability: Effects on Reliability, Validity, Test Scores, and Speed of Completion Educational and Psychological Measurement, April 1, 2009; 69(2): 322 - 350. [Abstract] [PDF]

				K. M. Kieffer and R. J. Reese Measurement of Test and Study Worry and Emotionality in College Students: A Psychometric Evaluation of the Test and Study Attitudes Inventory Educational and Psychological Measurement, April 1, 2009; 69(2): 303 - 321. [Abstract] [PDF]

				K. Murayama, M. Zhou, and J. C. Nesbit A Cross-Cultural Examination of the Psychometric Properties of Responses to the Achievement Goal Questionnaire Educational and Psychological Measurement, April 1, 2009; 69(2): 266 - 286. [Abstract] [PDF]

				V. H. Gregg and A. J. Shepherd Factor Structure of Scores on the State Version of the Four Dimension Mood Scale Educational and Psychological Measurement, February 1, 2009; 69(1): 146 - 156. [Abstract] [PDF]

				J. Xu Models of Secondary School Students' Interest in Homework: A Multilevel Analysis American Educational Research Journal, December 1, 2008; 45(4): 1180 - 1205. [Abstract] [Full Text] [PDF]

				H. L. Campbell, C. L. Barry, J. N. Joe, and S. J. Finney Configural, Metric, and Scalar Invariance of the Modified Achievement Goal Questionnaire Across African American and White University Students Educational and Psychological Measurement, December 1, 2008; 68(6): 988 - 1007. [Abstract] [PDF]

				N. Kersting Using Video Clips of Mathematics Classroom Instruction as Item Prompts to Measure Teachers' Knowledge of Teaching Mathematics Educational and Psychological Measurement, October 1, 2008; 68(5): 845 - 861. [Abstract] [PDF]

				I. Green-Demers, L. Legault, D. Pelletier, and L. G. Pelletier Factorial Invariance of the Academic Amotivation Inventory (AAI) Across Gender and Grade in a Sample of Canadian High School Students Educational and Psychological Measurement, October 1, 2008; 68(5): 862 - 880. [Abstract] [PDF]

				J. A. Worley, M. Vassar, D. L. Wheeler, and L. L. B. Barnes Factor Structure of Scores From the Maslach Burnout Inventory: A Review and Meta-Analysis of 45 Exploratory and Confirmatory Factor-Analytic Studies Educational and Psychological Measurement, October 1, 2008; 68(5): 797 - 823. [Abstract] [PDF]

				P. A. Lowe and S. W. Lee Factor Structure of the Test Anxiety Inventory for Children and Adolescents (TAICA) Scores Across Gender Among Students in Elementary and Secondary School Settings Journal of Psychoeducational Assessment, September 1, 2008; 26(3): 231 - 246. [Abstract] [PDF]

				P. A. Lowe, S. W. Lee, K. M. Witteborg, K. W. Prichard, M. E. Luhr, C. M. Cullinan, B. A. Mildren, J. M. Raad, R. A. Cornelius, and M. Janik The Test Anxiety Inventory for Children and Adolescents (TAICA): Examination of the Psychometric Properties of a New Multidimensional Measure of Test Anxiety Among Elementary and Secondary School Students Journal of Psychoeducational Assessment, September 1, 2008; 26(3): 215 - 230. [Abstract] [PDF]

				K. Guttmannova, J. M. Szanyi, and P. W. Cali Internalizing and Externalizing Behavior Problem Scores: Cross-Ethnic and Longitudinal Measurement Invariance of the Behavior Problem Index Educational and Psychological Measurement, August 1, 2008; 68(4): 676 - 694. [Abstract] [PDF]

				M. B. Donnellan A Psychometric Evaluation of Two Achievement Goal Inventories Educational and Psychological Measurement, August 1, 2008; 68(4): 643 - 658. [Abstract] [PDF]

				Huijun Li, D. Lee, S. I. Pfeiffer, and Y. Petscher Parent Ratings Using the Chinese Version of the Parent Gifted Rating Scales-School Form Reliability and Validity for Chinese Students Educational and Psychological Measurement, August 1, 2008; 68(4): 659 - 675. [Abstract] [PDF]

				I. Isemonger Scores on a Japanese-Language Version of the Learning Channel Preference Checklist: A Questionable Instrument Within a Questionable Line of Instrumentation Journal of Psychoeducational Assessment, June 1, 2008; 26(2): 148 - 155. [Abstract] [PDF]

				V. J. Fortunato, M. K. LeBourgeois, and J. Harsh Development of a Five-Dimensional Measure of Adult Sleep Quality Educational and Psychological Measurement, June 1, 2008; 68(3): 488 - 514. [Abstract] [PDF]

				Jianzhong Xu Validation of Scores on the Homework Management Scale for High School Students Educational and Psychological Measurement, April 1, 2008; 68(2): 304 - 324. [Abstract] [PDF]

				R. R. Hirschfeld, C. H. Thomas, and D. B. McNatt Implications of Self-Deception for Self-Reported Intrinsic and Extrinsic Motivational Dispositions and Actual Learning Performance: A Higher Order Structural Model Educational and Psychological Measurement, February 1, 2008; 68(1): 154 - 173. [Abstract] [PDF]

				S. Escorial and M. J. Navas Analysis of the Gender Variable in the Eysenck Personality Questionnaire Revised Scales Using Differential Item Functioning Techniques Educational and Psychological Measurement, December 1, 2007; 67(6): 990 - 1001. [Abstract] [PDF]

				M. A. Taylor and D. A. Pastor A Confirmatory Factor Analysis of the Student Adaptation to College Questionnaire Educational and Psychological Measurement, December 1, 2007; 67(6): 1002 - 1018. [Abstract] [PDF]

				F. Lievens, F. Anseel, M. M. Harris, and J. Eisenberg Measurement Invariance of the Pay Satisfaction Questionnaire Across Three Countries Educational and Psychological Measurement, December 1, 2007; 67(6): 1042 - 1051. [Abstract] [PDF]

				D. R. Avery, S. Tonidandel, K. M. Thomas, C. D. Johnson, and D. A. Mack Assessing the Multigroup Ethnic Identity Measure for Measurement Equivalence Across Racial and Ethnic Groups Educational and Psychological Measurement, October 1, 2007; 67(5): 877 - 888. [Abstract] [PDF]

				J. D. Whitaker Sena, P. A. Lowe, and S. W. Lee Significant Predictors of Test Anxiety Among Students With and Without Learning Disabilities J Learn Disabil, August 1, 2007; 40(4): 360 - 376. [Abstract] [PDF]

				R. E. Schumacker and E. V. Smith Jr. A Rasch Perspective Educational and Psychological Measurement, June 1, 2007; 67(3): 394 - 409. [Abstract] [PDF]

				T. E. Beckert, R. D. Strom, P. S. Strom, C.-T. Yang, and A. Singh Parent Success Indicator: Cross-Cultural Development and Factorial Validation Educational and Psychological Measurement, April 1, 2007; 67(2): 311 - 327. [Abstract] [PDF]

				I. Isemonger and C. Sheppard A Construct-Related Validity Study on a Korean Version of the Perceptual Learning Styles Preference Questionnaire Educational and Psychological Measurement, April 1, 2007; 67(2): 357 - 368. [Abstract] [PDF]

				W. Viechtbauer Approximate Confidence Intervals for Standardized Effect Sizes in the Two-Independent and Two-Dependent Samples Design Journal of Educational and Behavioral Statistics, March 1, 2007; 32(1): 39 - 60. [Abstract] [Full Text] [PDF]

				D. J. Woehr, L. M. Arciniega, and D. H. Lim Examining Work Ethic Across Populations: A Comparison of the Multidimensional Work Ethic Profile Across Three Diverse Cultures Educational and Psychological Measurement, February 1, 2007; 67(1): 154 - 168. [Abstract] [PDF]

				F. Cano An In-Depth Analysis of the Learning and Study Strategies Inventory (LASSI) Educational and Psychological Measurement, December 1, 2006; 66(6): 1023 - 1038. [Abstract] [PDF]

				J. E. Helms, K. T. Henze, T. L. Sass, and V. A. Mifsud Treating Cronbach's Alpha Reliability Coefficients as Data in Counseling Research The Counseling Psychologist, September 1, 2006; 34(5): 630 - 660. [Abstract] [PDF]

				S. L. Davis and S. J. Finney A Factor Analytic Study of the Cross-Cultural Adaptability Inventory Educational and Psychological Measurement, April 1, 2006; 66(2): 318 - 330. [Abstract] [PDF]

				P. A. Lowe and C. R. Reynolds Examination of the Psychometric Properties of the Adult Manifest Anxiety Scale-Elderly Version Scores Educational and Psychological Measurement, February 1, 2006; 66(1): 93 - 115. [Abstract] [PDF]

				A. J. Fairchild and S. J. Finney Investigating Validity Evidence for the Experiences in Close Relationships-Revised Questionnaire Educational and Psychological Measurement, February 1, 2006; 66(1): 116 - 135. [Abstract] [PDF]

				J. J. Barnette ScoreRel CI: An Excel Program for Computing Confidence Intervals for Commonly Used Score Reliability Coefficients Educational and Psychological Measurement, December 1, 2005; 65(6): 980 - 983. [Abstract] [PDF]

				R. J. De Ayala, D. J. Vonderharr-Carlson, and D. Kim Assessing the Reliability of the Beck Anxiety Inventory Scores Educational and Psychological Measurement, October 1, 2005; 65(5): 742 - 756. [Abstract] [PDF]

				P. A. Lowe and C. R. Reynolds Factor Structure of AMAS-C Scores Across Gender among Students in Collegiate Settings Educational and Psychological Measurement, August 1, 2005; 65(4): 687 - 708. [Abstract] [PDF]

				K. Boies, T.-Y. Yoo, A. Ebacher, K. Lee, and M. C. Ashton Validity Studies Psychometric Properties of Scores on the French and Korean Versions of the Hexaco Personality Inventory Educational and Psychological Measurement, December 1, 2004; 64(6): 992 - 1006. [Abstract] [PDF]

				J. L. Mendoza, D. E. Bard, M. D. Mumford, and S. C. Ang Criterion-Related Validity in Multiple-Hurdle Designs: Estimation and Bias Organizational Research Methods, October 1, 2004; 7(4): 418 - 441. [Abstract] [PDF]

				S. S. Russell, C. Spitzmuller, L. F. Lin, J. M. Stanton, P. C. Smith, and G. H. Ironson Shorter can Also be Better: The Abridged Job in General Scale Educational and Psychological Measurement, October 1, 2004; 64(5): 878 - 893. [Abstract] [PDF]

				C. K. Enders The Impact of Missing Data on Sample Reliability Estimates: Implications for Reliability Reporting Practices Educational and Psychological Measurement, June 1, 2004; 64(3): 419 - 436. [Abstract] [PDF]

				V. J. Fortunato A Comparison of the Construct Validity of Three Measures of Negative Affectivity Educational and Psychological Measurement, April 1, 2004; 64(2): 271 - 289. [Abstract] [PDF]

				S. J. Finney, S. L. Pieper, and K. E. Barron Examining the Psychometric Properties of the Achievement Goal Questionnaire in a General Academic Context Educational and Psychological Measurement, April 1, 2004; 64(2): 365 - 382. [Abstract] [PDF]

				K. A. Barchard Does Emotional Intelligence Assist in the Prediction of Academic Success? Educational and Psychological Measurement, October 1, 2003; 63(5): 840 - 858. [Abstract] [PDF]

				G. A. Tasca, V. Illing, V. Lybanon-Daigle, H. Bissada, and L. Balfour Psychometric Properties of the Eating Disorders Inventory-2 among Women Seeking Treatment for Binge Eating Disorder Assessment, September 1, 2003; 10(3): 228 - 236. [Abstract] [PDF]

				P. Yin and X. Fan Assessing The Factor Structure Invariance Of Self-Concept Measurement Across Ethnic And Gender Groups: Findings From A National Sample Educational and Psychological Measurement, April 1, 2003; 63(2): 296 - 318. [Abstract] [PDF]

				D. M. Dimitrov Reliability: Arguments for Multiple Perspectives and Potential Problems with Generalization across Studies Educational and Psychological Measurement, October 1, 2002; 62(5): 783 - 801. [Abstract] [PDF]

				T. Vacha-Haase, R. K. Henson, and J. C. Caruso Reliability Generalization: Moving toward Improved Understanding and Use of Score Reliability Educational and Psychological Measurement, August 1, 2002; 62(4): 562 - 569. [Abstract] [PDF]

				K. D. Bird Confidence Intervals for Effect Sizes in Analysis of Variance Educational and Psychological Measurement, April 1, 2002; 62(2): 197 - 226. [Abstract] [PDF]