Sage Journals: Discover world-class research

Abstract

In meta-analysis, it is common to have dependent effect sizes, such as several effect sizes from the same sample but measured at different times. Cheung and Chan proposed the adjusted-individual and adjusted-weighted procedures to estimate the degree of dependence and incorporate this estimate in the meta-analysis. The present study extends the previous study by examining the case of heterogeneous degree of dependence. Simulation results reveal that these two procedures again generated less biased estimates of the degree of heterogeneity than the commonly used samplewise procedure and were statistically more powerful to detect true variations. In addition, the adjusted-weighted procedure generated slightly less biased estimates of the degree of heterogeneity than the adjusted-individual weighted procedure across conditions. Future directions to further refine these procedures are discussed.

Keywords

meta-analysis dependent effect size

Get full access to this article

View all access options for this article.

References

Becker, B.J. (1992). Using results from replicated studies to estimate linear models. Journal of Educational Statistics, 17, 341-362.

Bryk, A.S. , & Raudenbush, S.W. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.

Chapman, D.S. , Uggerslev, K.L. , Carrol, S.A. , Piasentin, K.A. , & Jones, D.A. (2005). Applicant attraction to organizations and job choice: A meta-analytic review of the correlates of recruiting outcomes. Journal of Applied Psychology, 90, 928-944.

Cheung, S.F. , & Chan, D.K. -S. (2004). Dependent effect sizes in meta-analysis: Incorporating the degree of interdependence. Journal of Applied Psychology , 89, 780-791.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.

Dwight, S.A. , & Feigelson, M.E. (2000). A quantitative review of the effect of computerized testing on the measurement of social desirability . Educational and Psychological Measurement, 60, 340-360.

Field, A.P. (2001). Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixed- and random-effects methods. Psychological Methods, 6, 161-180.

Gershoff, E.T. (2002). Corporal punishment by parents and associated child behaviors and experiences: A meta-analytic and theoretical review. Psychological Bulletin, 128, 539-579.

Gleser, L.J. , & Olkin, I. (1994). Stochastically dependent effect sizes. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 399-355). New York: Russell Sage Foundation.

10.

Hedges, L.V. , & Vevea, J.L. (1998). Fixed- and random-effects models in meta-analysis . Psychological Methods, 3, 486-504.

11.

Hunter, J.E. , & Schmidt, F.L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.

12.

James, L.R. , Demaree, R.G. , & Wolf, G. (1993). rwg: An assessment of within-group interrater agreement. Journal of Applied Psychology, 78, 306-309.

13.

Martinussen, M. , & Bjornstad, J.F. (1999). Meta-analysis calculations based on independent and nonindependent cases. Educational and Psychological Measurement, 59, 928-950.

14.

Nesbit, J.C. , & Adesope, O.O. (2006). Learning with concept and knowledge maps: A meta-analysis . Review of Educational Research, 76, 413-448.

15.

Schmidt, F.L. , Law, K. , Hunter, J.E. , & Rothstein, H.R. (1993). Refinements in validity generalization methods: Implications for the situational specificity hypothesis . Journal of Applied Psychology, 78, 3-12.

16.

Thoresen, C.J. , Kaplan, S.A. , Barsky, A.P. , Warren, C.R. , & de Chermont, K. (2003). The affective underpinnings of job perceptions and attitudes: A meta-analytic review and integration. Psychological Bulletin, 129, 914-945.

17.

Viswesvaran, C. , Sanchez, J.L. , & Fisher, J. (1999). The role of social support in the process of work stress: A meta-analysis. Journal of Vocational Behavior, 54, 314-334.

18.

Wang, S. , Jiao, H. , Young, M.J. , Brooks, T. , & Olson, J. (2007). A meta-analysis of testing mode effects in grade K-12 mathematics tests. Educational and Psychological Measurement , 67, 219-238.

19.

Williams, M.L. , McDaniel, M.A. , & Nguyen, N.T. (2006). A meta-analysis of the antecedents and consequences of pay level satisfaction. Journal of Applied Psychology, 91, 392-413.

20.

Zhao, H. , & Seibert, S.E. (2006). The Big Five personality dimensions and entrepreneurial status: A meta-analytical review. Journal of Applied Psychology , 91, 259-271.

Dependent Correlations in Meta-Analysis

Abstract

Keywords

Get full access to this article

References