|
Sign In to gain access to subscriptions and/or personal tools.
|
Correction for Attenuation With Biased Reliability Estimates and Correlated Errors in Populations and Samples
Donald W. Zimmerman
Carleton University, dwzimm{at}telus.net
Properties of the Spearman correction for attenuation were investigated using Monte Carlo methods, under conditions where correlations between error scores exist as a population parameter and also where correlated errors arise by chance in random sampling. Equations allowing for all possible dependence among true and error scores on two tests at both the sample and population levels were derived and compared to simulation results. The additional influence of biased estimates of reliability at both levels was examined. Research settings under which the correction for attenuation can be useful in data analysis and those under which it is inaccurate and extremely variable were distinguished.
Key Words: correction for attenuation Spearman attenuation formula error of measurement reliability true scores error scores observed scores correlated errors population sample
References
- Becker, G. (2001). On the far reaching effects of using biased estimates of score reliability: An examination of the problem in 20 data analyses. Psychological Reports, 89, 291-307.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Bobko, P. (1983). An analysis of correlations corrected for attenuation and range restriction. Journal of Applied Psychology, 68, 584-589.[CrossRef][Web of Science]
- Charles, E.P. (2005). The correction for attenuation due to measurement error: Clarifying concepts and creating confidence sets. Psychological Methods, 10, 206-226.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Fisher, R.A. (1915). Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika, 10, 107.
- Forsyth, R.A., & Feldt, L.S. (1969). An investigation of empirical sampling distributions of correlation coefficients corrected for attenuation. Educational and Psychological Measurement, 29, 16-71.
- Guttman, L. (1953). Reliability formulas that do not assume experimental independence. Psychometrika, 18, 225-239.[CrossRef][Web of Science]
- Johnson, H.G. (1944). An empirical study of the influence of errors of measurement on correlation. American Journal of Psychology, 57, 521-536.[CrossRef][Web of Science]
- Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading, MA: McGraw-Hill.
- Marsaglia, G., & Bray, T.A. (1964). A convenient method for generating normal variables. SIAM Review, 6, 260-264.[CrossRef][Web of Science]
- Marsaglia, G., Zaman, A., & Tsang, W.W. (1990). Toward a universal random number generator. Statistics and Probability Lectures, 8, 35-39.
- Millsap, R.E. (1988). Sampling variance in attenuated correlation coefficients: A Monte Carlo study. Journal of Applied Psychology, 73, 316-319.[CrossRef][Web of Science]
- Muchinsky, P.M. (1996). The correction for attenuation. Educational and Psychological Measurement, 56, 63-75.[Abstract]
- Novick, M.R. (1966). The axioms and principal results of classical test theory. Journal of Mathematical Psychology, 3, 1-18.[Medline]
[Order article via Infotrieve]
- Novick, M.R., & Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32, 1-13.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Pashley, P.J. (1993). On generating random sequences. In G. Keren & C. Lewis (Eds.), Handbook for data analysis in the behavioral sciences: Methodological issues (pp. 395-415). Hillsdale, NJ: Lawrence Erlbaum.
- Pearson, K. (1904). On the laws of inheritance in man: II. On the inheritance of the mental and moral characters in man, and its comparison with the inheritance of the physical characters. Biometrika, 2, 131-159.
- Rozeboom, W.W. (1966). Foundations of the theory of prediction. Homewood, IL: Dorsey.
- Spearman, C. (1904). The proof and measurement of association between two things. American Journal of Psychology, 15, 72-101.[CrossRef][Web of Science]
- Spearman, C. (1910). Correlation calculated with faulty data. British Journal of Psychology, 3, 271-295.
- Thouless, E.L. (1939). The effects of error of measurement on correlation coefficients. British Journal of Psychology, 29, 383-403.
- Winne, P.H., & Belfry, M.J. (1982). Interpretive problems when correcting for attenuation. Journal of Educational Measurement, 19, 125-134.[CrossRef][Web of Science]
- Zimmerman, D.W., & Williams, R.H. (1977). The theory of test validity and correlated errors of measurement. Journal of Mathematical Psychology, 16, 135-152.
- Zimmerman, D.W., & Williams, R.H. (1997). Properties of the Spearman correction for attenuation for normal and realistic non-normal distributions. Applied Psychological Measurement, 21, 253-279.[Abstract/Free Full Text]
- Zimmerman, D.W., Zumbo, B.D., & Lalonde, C. (1993). Coefficient alpha as an estimate of test reliability under violation of two assumptions. Educational and Psychological Measurement, 53, 33-49.[Abstract]
This version was published on December
1, 2007
Educational and Psychological Measurement, Vol. 67, No. 6,
920-939 (2007)
DOI: 10.1177/0013164406299132

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
|
|