Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Click here to sign up for SAGE Journal Email Alerts today!

Sign In to gain access to subscriptions and/or personal tools.
Educational and Psychological Measurement
This Article
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
0013164407301528v1
68/1/120    most recent
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Howell, R. T.
Right arrow Articles by Shields, A. L.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

The File Drawer Problem in Reliability Generalization

A Strategy to Compute a Fail-Safe N With Reliability Coefficients

Ryan T. Howell

San Francisco State University, rhowell{at}sfsu.edu

Alan L. Shields

East Tennessee State University

Meta-analytic reliability generalizations (RGs) are limited by the scarcity of reliability reporting in primary articles, and currently, RG investigators lack a method to quantify the impact of such nonreporting. This article introduces a stepwise procedure to address this challenge. First, the authors introduce a formula that allows researchers to estimate the lower bound population average reliability for a desired instrument. Second, they present an equation to determine the Fail-Safe N for RG. This equation estimates the number of ``file drawer'' studies required to drop the aggregate score reliability of an instrument below a specified criterion value. Finally, the authors demonstrate the utility of these equations using published RG studies. Comments on the conclusions drawn from each RG application are provided.

Key Words: reliability • reliability generalization • Fail-Safe N • meta-analysis

This version was published on February 1, 2008

Educational and Psychological Measurement, Vol. 68, No. 1, 120-128 (2008)
DOI: 10.1177/0013164407301528
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Journal of Cross-Cultural PsychologyHome page
Q.-L. Huynh, R. T. Howell, and V. Benet-Martinez
Reliability of Bidimensional Acculturation Scores: A Meta-Analysis
Journal of Cross-Cultural Psychology, March 1, 2009; 40(2): 256 - 274.
[Abstract] [PDF]