Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

CiteULike is a free service for managing and discovering scholarly references - click here to get started.

Sign In to gain access to subscriptions and/or personal tools.
Educational and Psychological Measurement
This Article
Right arrow Abstract Freely available
Right arrow Free Full Text (Free PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Miller, C. S.
Right arrow Articles by Weiss, R. D.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Substance Use Scales of the Minnesota Multiphasic Personality Inventory

An Exploration of Score Reliability Via Meta-Analysis

Christopher S. Miller

The University of Montana

Alan L. Shields

East Tennessee State University, shields{at}etsu.edu

Delia Campfield

The University of Montana

Kim A. Wallace

The University of Montana

Roger D. Weiss

Harvard University

Three drug and alcohol use screening scales are embedded within the Minnesota Multiphasic Personality Inventory—2: the MacAndrew Alcoholism Scale (MAC) and its revised version (MAC-R), the Addiction Acknowledgement Scale (AAS), and the Addiction Potential Scale (APS). The current study evaluated the reliability reporting practices among 210 studies administering the MAC/MAC-R, APS, and/or AAS. Furthermore, reliability generalization methods were used to characterize the previously reported reliability estimates associated with each instrument. The vast majority of studies (90.6%) did not provide measurement reliability data, suggesting a need for improved psychometric reporting. Data from the remaining studies yielded mean and median score reliability estimates below .70 for each of the identified measures. Although limited in some instances by sample size constraints, results suggest that these instruments tend not to produce scores with acceptable levels of reliability for most research or clinical situations.

Key Words: Minnesota Multiphasic Personality Inventory—2 (MMPI-2) • substance abuse scales • reliability induction • reliability generalization • meta-analysis

References

  • Allen, J.P., Faden, V.B., Miller, A., & Rawlings, R.R. (1991). Personality correlates of chemically dependent patients scoring high versus low on the MacAndrew Scale: A review of the literature. Psychology of Addictive Behaviors, 10, 59-65.
  • Archer, R.P. (1997). MMPI-A: Assessing adolescent psychopathology (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
  • *Bruder, C.I. (1982). A multivariate approach to the classification of alcoholics in an inpatient clinical population. Journal of Studies on Alcohol, 43, 843-850.[Web of Science][Medline] [Order article via Infotrieve]
  • Butcher, J.N., Dahlstrom, W.G., Graham, J.R., Tellegen, A., & Kaemmer, B. (1989). MMPI-2: Manual for administration and scoring. Minneapolis: University of Minnesota Press.
  • Butcher, J.N., & Rouse, S.V. (1996). Clinical personality assessment. Annual Review of Psychology, 47, 385-401.
  • Butcher, J.N., Williams, C.L., Graham, J.R., Archer, R.P., Tellegen, A., Ben-Porath, Y., et al. (1992). MMPI-A (Minnesota Multiphasic Personality Inventory-Adolescent): Manual for administration, scoring, and interpretation. Minneapolis: University of Minnesota Press.
  • Cervovsky, Z.Z. (1985). MacAndrew Alcoholism Scale and repression: Detection of false negatives. Psychological Reports, 57, 191-194.[Web of Science][Medline] [Order article via Infotrieve]
  • *Chalmers, D., Olenick, N.L., & Stein, W. (1993). Dispositional traits as risk in problem drinking. Journal of Substance Abuse, 5, 401-410.[CrossRef][Medline] [Order article via Infotrieve]
  • Charter, R.A. (1996). Revisiting the standard errors of measurement, estimate, and prediction and their application to test scores. Perceptual and Motor Skills, 82, 1139-1144.[Web of Science]
  • *Clements, R., & Heintz, J.M. (2002). Diagnostic accuracy and factor structure of the AAS and APS scales of the MMPI-2. Journal of Personality Assessment, 79, 564-582.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Colligan, R.C., & Offord, K.P. (1990). MacAndrew versus MacAndrew: The relative efficacy of the MAC and the SAP scales for the MMPI in screening male adolescents for substance misuse. Journal of Personality Assessment, 50, 708-716.[CrossRef]
  • Cooper-Hakim, A., & Viswesvaran, C. (2002). A meta-analytic review of the MacAndrew Alcoholism Scale. Educational and Psychological Measurement, 62, 818-829.[Abstract/Free Full Text]
  • *Davis, L.J., Colligan, R.C., Morse, R.M., & Offord, K.P. (1987). Validity of the MacAndrew Scale in a general medical population. Journal of Studies on Alcohol, 48, 202-206.[Web of Science][Medline] [Order article via Infotrieve]
  • Department of Health and Human Services. ( 1990). Healthy people 2000: National health promotion and disease prevention objectives. Rockville, MD: U.S. Department of Health and Human Services, Public Health Services.
  • *Earleywine, M., Finn, P.R., Peterson, J.B., & Pihl, R.O. (1992). Factor structure and correlates of the Tridimensional Personality Questionnaire. Journal of Studies on Alcohol, 53, 233-238.[Web of Science][Medline] [Order article via Infotrieve]
  • Ewing, J.A. (1984). Detecting alcoholism: The CAGE questionnaire. Journal of the American Medical Association, 252, 1905-1907.[Abstract/Free Full Text]
  • Gottesman, I.I., & Prescott, C.A. (1989). Abuses of the MacAndrew MMPI Alcoholism Scale: A critical review. Clinical Psychology Review, 9, 223-242.[CrossRef][Web of Science]
  • Graham, J.R. (1987). The MMPI: A practical guide. New York: Oxford University Press.
  • *Graham, J.R., & Schwartz, M.F. (1981). Methodological issues and the construct validity of the MacAndrew Alcoholism Scale: A response to the rebuttal and constructive comments of Merenda and Sparadeo. Journal of Consulting and Clinical Psychology, 49, 971-973.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Graham, J.R., & Strenger, V. (1988). MMPI characteristics of alcoholics. Journal of Consulting and Clinical Psychology, 56, 197-205.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Greene, R.L., Arredondo, R., & Davis, H.G. (1990, August). MMPI and MMPI-2 MacAndrew Alcoholism Scales: Comparability of classification rates. Paper presented at the annual meeting of the American Psychological Association, Boston.
  • Hathaway, S.R., & McKinley, J.C. (1943). The Minnesota Multiphasic Inventory (Rev. ed., 2nd ed.). Minneapolis, MN: University of Minnesota Press.
  • Henson, R.K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.[Web of Science]
  • Henson, R.K., Kogan, L.R., & Vacha-Haase, T. (2001). A reliability generalization study of the Teacher Efficacy Scale and related instruments. Educational and Psychological Measurement, 61, 404-420.[Abstract/Free Full Text]
  • Henson, R.K., & Thompson, B. (2002). Characterizing measurement error in scores across studies: Some recommendations for conducting ``reliability generalization'' studies. Measurement and Evaluation in Counseling and Development, 35, 113-127.[Web of Science]
  • Hogan, T.P., Benjamin, A., & Brezinski, K.L. (2000). Reliability methods: A note on the frequency of use of various types. Educational and Psychological Measurement, 6, 523-531.
  • Jacobson, G.R. (1983). Detection, assessment, and diagnosis of alcoholism: Current techniques. Recent Developments in Alcoholism, 1, 377-413.[Medline] [Order article via Infotrieve]
  • Kessler, R.C., McGonagle, K.A., Zhao, S., Nelson, C.B., Hughes, M., Eshleman, S., et al. (1994). Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States: Results from the National Comorbidity Study. Archives of General Psychiatry, 51, 8-19.[Abstract/Free Full Text]
  • Kessler, R.C., Nelson, C.B., McGonagle, K.A., Edlund, M.J., Frank, R.G., & Leaf, P.J. (1996). The epidemiology of co-occurring addictive and mental disorders: Implications for prevention and service utilization. American Journal of Orthopsychiatry, 66, 17-31.[Web of Science][Medline] [Order article via Infotrieve]
  • Kieffer, K.M., Cronin, C., & Fister, M.C. (2004). Exploring variability and sources of measurement error in alcohol expectancy questionnaire reliability coefficients: A meta-analytic reliability generalization study. Journal of Studies on Alcohol, 65, 663-671.[Web of Science][Medline] [Order article via Infotrieve]
  • Kuder, G.F., & Richardson, M.W. (1937). The theory of the estimation of test reliability. Psychometrika, 2, 151-160.[CrossRef][Web of Science]
  • Lane, G.G., White, A.E., & Henson, R.K. (2001). Expanding reliability generalization methods with KR-21 estimates: An RG study of the Coopersmith Self-Esteem Inventory. Educational and Psychological Measurement, 62, 685-711.[CrossRef][Web of Science]
  • Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
  • MacAndrew, C. (1965). The differentiation of male alcoholic outpatients from nonalcoholic psychiatric patients by means of the MMPI. Quarterly Journal of Studies on Alcohol, 28, 43-51.
  • MacAndrew, C. (1981). What the MAC Scale tells us about men alcoholics: An interpretive review. Journal of Studies on Alcohol, 42, 604-625.[Web of Science][Medline] [Order article via Infotrieve]
  • McCrady, B.S., & Langenbucher, J.W. (1996). Alcohol treatment and health care system reform. Archives of General Psychiatry, 53, 737-745.[Abstract/Free Full Text]
  • Micucci, J.A. (2002). Accuracy of MMPI-A scales ACK, MAC-R, and PRO in detecting comorbid substance abuse among psychiatric inpatients. Assessment, 9, 111-122.[Abstract/Free Full Text]
  • Minkoff, K. (2001). Developing standards of care for individuals with co-occurring psychiatric and substance use disorders. Psychiatric Services, 52, 597-599.[Free Full Text]
  • *Myerholtz, L.E. (1998). Screening college students for alcohol problems: Psychometric assessment of the SASSI-2. Journal of Studies on Alcohol, 59, 439-446.[Web of Science][Medline] [Order article via Infotrieve]
  • *Myerholtz, L.E., & Rosenberg, H. (1997). Screening DUI offenders for alcohol problems: Psychometric assessment of the substance abuse screening inventory. Psychology of Addictive Behaviors, 11, 155-165.[CrossRef][Web of Science]
  • *Patton, D., Barnes, G.E., & Murray, R.P. (1994). The reliability and construct validity of two measures of addictive personality. International Journal of the Addictions, 29, 999-1014.[Web of Science][Medline] [Order article via Infotrieve]
  • Preng, K.W., & Clopton, J.R. (1986). Application to the MacAndrew Alcoholism Scale to alcoholics with psychiatric diagnosis. Journal of Personality Assessment, 50, 113-122.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Rouse, S.V., Butcher, J.N., & Miller, K.B. (1999). Assessment of substance abuse in psychotherapy clients: The effectiveness of the MMPI-2 substance abuse scales. Psychological Assessment, 11, 101-107.[CrossRef][Web of Science]
  • Schuckit, M.A. (2000). Drug and alcohol abuse: A clinical guide to diagnosis and treatment. (5th ed.). New York: Plenum.
  • Schwartz, M.F., & Graham, J.R. (1979). Construct validity of the MacAndrew Alcoholism Scale. Journal of Consulting & Clinical Psychology, 47, 1090-1095.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Selzer, M.L. (1971). The Michigan Alcoholism Screening Test: The quest for a new diagnostic instrument. American Journal of Psychiatry, 127, 1653-1658.[Abstract/Free Full Text]
  • Shields, A.L., & Caruso, J.C. (2003). Reliability generalization of the Alcohol Use Disorders Identification Test. Educational and Psychological Measurement, 63, 404-413.[Abstract]
  • Shields, A.L., & Caruso, J.C. (2004). A reliability induction and reliability generalization study of the CAGE questionnaire. Educational and Psychological Measurement, 64, 254-270.[Abstract/Free Full Text]
  • Shields, A.L., Howell, R.T., Potter, J.S., & Weiss, R.D. (in press). The Michigan Alcoholism Screening Test and its shortened forms: A meta-analytic inquiry into score reliability. Substance Use and Misuse.
  • *Svanum, S., & Ehrmann, L. (1993). The validity of the MMPI in identifying alcoholics in a university setting. Journal of Studies on Alcohol, 54, 722-729.[Web of Science][Medline] [Order article via Infotrieve]
  • *Svanum, S., McGrew, J., & Ehrmann, L. (1994). Validity of the substance abuse scales of the MMPI-2 in a college student sample. Journal of Personality Assessment, 62, 427-439.[Web of Science][Medline] [Order article via Infotrieve]
  • Thompson, B. (1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837-847.
  • Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6-20.[Abstract]
  • Vacha-Haase, T., Henson, R.K., & Caruso, J.C. (2002). Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562-569.[Abstract/Free Full Text]
  • Vacha-Haase, T., Kogan, L.R., Tani, C.R., & Woodall, R.A. (2001). Reliability generalization: Exploring variation of reliability of MMPI clinical scales scores. Educational and Psychological Measurement, 61, 45-59.[Abstract/Free Full Text]
  • Vacha-Haase, T., Kogan, L.R., & Thompson, B. (2000). Sample compositions and variabilities in published studies versus those in test manuals: Validity of score reliability inductions. Educational and Psychological Measurement, 60, 509-522.[Abstract/Free Full Text]
  • Vacha-Haase, T., Tani, C.R., Kogan, L.R., Woodall, R.A., & Thompson, B. (2001). Reliability generalization: Exploring reliability variations on MMPI/MMPI-2 validity scale scores. Assessment, 8, 391-401.[Abstract/Free Full Text]
  • Weed, N.C., Butcher, J.N., & Ben-Porath, Y.S. (1995). MMPI-2 measures of substance abuse. In J. N. Butcher, N. James, & C. D. Spielberger (Eds.), Advances in personality assessment (pp. 121-145). Hillsdale, NJ: Lawrence Erlbaum.
  • *Weed, N.C., Butcher, J.N., McKenna, T., & Ben-Porath, Y.S. (1992). New measures for assessing alcohol and drug abuse with the MMPI-2: The APS and the AAS. Journal of Personality Assessment, 58, 389-404.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Wilkinson, L., & the American Psychological Association Task Force on Statistical Inference. (1999). Statistical methods in psychology journals. American Psychologist, 54, 594-604.[CrossRef]

This version was published on December 1, 2007

Educational and Psychological Measurement, Vol. 67, No. 6, 1052-1065 (2007)
DOI: 10.1177/0013164406299130
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?



This Article
Right arrow Abstract Freely available
Right arrow Free Full Text (Free PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Miller, C. S.
Right arrow Articles by Weiss, R. D.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?