This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Sawilowsky, S. S. Search for Related Content Social Bookmarking                         What's this?

Psychometrics versus Datametrics: Comment on Vacha-Haase’s "Reliability Generalization" Method and Some Epm Editorial Policies

Wayne State Universityshlomo{at}edstat.coe.wayne.edu.

The present article reviews issues regarding test reliability, which is psychometric terminology, and score reliability, which is score-centric terminology. These issues have arisen, in part, due to some EPM editorial policies and Vacha-Haase’s "reliability generalization" proposal. The article includes (a) a brief historical review of reliability terminology, (b) discussion on the emergence of datametrics (loosely defined as the application of psychometry to scores as opposed to an instrument) including a review of textbook authors’uses of psychometric versus datametric terminology, (c) discussion of problems with datametrics, and (d) a critique of Vacha-Haase’s proposed meta-analytic reliability generalization via dummy-coded regression. The article concludes with a brief summary that presents several suggestions.

Educational and Psychological Measurement, Vol. 60, No. 2, 157-173 (2000)
DOI: 10.1177/00131640021970439


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				J. L. Romano and J. D. Kromrey What Are the Consequences If the Assumption of Independent Observations Is Violated in Reliability Generalization Meta-Analysis Studies? Educational and Psychological Measurement, June 1, 2009; 69(3): 404 - 428. [Abstract] [PDF]

				C. Mason, R. Allam, and M. T. Brannick How to Meta-Analyze Coefficient-of-Stability Estimates: Some Recommendations Based on Monte Carlo Studies Educational and Psychological Measurement, October 1, 2007; 67(5): 765 - 783. [Abstract] [PDF]

				R. J. De Ayala, D. J. Vonderharr-Carlson, and D. Kim Assessing the Reliability of the Beck Anxiety Inventory Scores Educational and Psychological Measurement, October 1, 2005; 65(5): 742 - 756. [Abstract] [PDF]

				N. O'rourke Reliability Generalization of Responses by Care Providers to the Center for Epidemiologic Studies-Depression Scale Educational and Psychological Measurement, December 1, 2004; 64(6): 973 - 990. [Abstract] [PDF]

				A. L. Shields and J. C. Caruso A Reliability Induction and Reliability Generalization Study of the Cage Questionnaire Educational and Psychological Measurement, April 1, 2004; 64(2): 254 - 270. [Abstract] [PDF]

				D. M. Dimitrov Reliability: Arguments for Multiple Perspectives and Potential Problems with Generalization across Studies Educational and Psychological Measurement, October 1, 2002; 62(5): 783 - 801. [Abstract] [PDF]

				R. M. Capraro and M. M. Capraro Myers-Briggs Type Indicator Score Reliability Across: Studies a Meta-Analytic Reliability Generalization Study Educational and Psychological Measurement, August 1, 2002; 62(4): 590 - 602. [Abstract] [PDF]

				G. G. Lane, A. E. White, and R. K. Henson Expanding Reliability Generalization Methods with KR-21 Estimates an RG Study of the Coopersmith Self-Esteem Inventory Educational and Psychological Measurement, August 1, 2002; 62(4): 685 - 711. [Abstract] [PDF]

				B. Thompson and C. Cook Stability of the Reliability of LibQual+TM Scores a Reliability Generalization Meta-Analysis Study Educational and Psychological Measurement, August 1, 2002; 62(4): 735 - 743. [Abstract] [PDF]

				J. C. Caruso, K. Witkiewitz, A. Belcourt-Dittloff, and J. D. Gottlieb Reliability of Scores from the Eysenck Personality Questionnaire: A Reliability Generalization Study Educational and Psychological Measurement, August 1, 2001; 61(4): 675 - 689. [Abstract] [PDF]

				M. M. Capraro, R. M. Capraro, and R. K. Henson Measurement Error of Scores on the Mathematics Anxiety Rating Scale across Studies Educational and Psychological Measurement, June 1, 2001; 61(3): 373 - 386. [Abstract] [PDF]

				T. Vacha-Haase, L. R. Kogan, and B. Thompson Sample Compositions and Variabilities in Published Studies versus Those in Test Manuals: Validity of Score Reliability Inductions Educational and Psychological Measurement, August 1, 2000; 60(4): 509 - 522. [Abstract] [PDF]

				B. Thompson and T. Vacha-Haase Psychometrics is Datametrics: the Test is not Reliable Educational and Psychological Measurement, April 1, 2000; 60(2): 174 - 195. [Abstract] [PDF]