The purpose of this study was to describe common approaches used by nursing researchers to test mediation models and evaluate them within the context of current methodological advances. MEDLINE was used to locate studies testing a mediation model and published from 2004 to 2015 in nursing journals. Design (experimental/correlation, cross-sectional/longitudinal, model complexity) and analysis (method, inclusion of test of mediated effect, violations/discussion of assumptions, sample size/power) characteristics were coded for 456 studies. General trends were identified using descriptive statistics. Consistent with findings of reviews in other disciplines, evidence was found that nursing researchers may not be aware of the strong assumptions and serious limitations of their analyses. Suggestions for strengthening the rigor of such studies and an overview of current methods for testing more complex models, including longitudinal mediation processes, are presented.
BaronR. M.KennyD. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182. doi:10.1037/0022-3514.51.6.1173
2.
BiesanzJ. C.FalkC. F.SavaleiV. (2010). Assessing mediational models: Testing and interval estimation for indirect effects. Multivariate Behavioral Research, 45, 661-701. doi:10.1080/00273171.2010.498292
3.
CheongJ.MacKinnonD. P.KhooS. T. (2003). Investigation of mediational processes using parallel process latent growth curve modeling. Structural Equation Modeling, 10, 238-262. doi:10.1207/S15328007SEM1002_5
4.
ColeD. A.MaxwellS. E. (2003). Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology, 112, 558-577. doi:10.1037/0021-843X.112.4.558
5.
ColeD. A.PreacherK. J. (2014). Manifest variable path analysis: Potentially serious and misleading consequences due to uncorrected measurement error. Psychological Methods, 19, 300-315. doi:10.1037/a0033805
6.
DudleyW. N.BenuzilloJ. G.CarricoM. S. (2004). SPSS and SAS programming for the testing of mediation models. Nursing Research, 53, 59-62. doi:10.1097/00006199-200401000-00009
7.
FairchildA. J.McQuillinS. D. (2010). Evaluating mediation and moderation effects in school psychology: A presentation of methods and review of current practice. Journal of School Psychology, 48, 53-84. doi:10.1016/j.jsp.2009.09.001
8.
FrazierP. A.TixA. P.BarronK. E. (2004). Testing moderator and mediator effects in counseling psychology research. Journal of Counseling Psychology, 51, 115-134. doi:10.1037/0022-0167.51.1.115
9.
FritzM. S.MacKinnonD. P. (2007). Required sample size to detect the mediated effect. Psychological Science, 18, 233-239. doi:10.1111/j.1467-9280.2007.01882.x
10.
GelfandL. A.MensingerJ. L.TenhaveT. (2009). Mediation analysis: A retrospective snapshot of practice and more recent directions. The Journal of General Psychology, 136, 153-176. doi:10.3200/GENP.136.2.153-178
11.
HoyleR. H.KennyD. A. (1999). Sample size, reliability, and tests of statistical mediation. In HoyleR. H. (Ed.), Statistical strategies for small sample research (pp. 195-222). Thousand Oaks, CA: SAGE.
12.
HoytW. T.ImelZ. E.ChanF. (2008). Multiple regression and correlation techniques: Recent controversies and best practices. Rehabilitation Psychology, 53, 321-339. doi:10.1037/a0013021
13.
ImaiK.KeeleL.TingleyD. (2010). A general approach to causal mediation analysis. Psychological Methods, 15, 309-334. doi:10.1037/a0020761
14.
ImaiK.KeeleL.TingleyD.YamamotoT. (2014). Comment on Pearl: Practical implications of theoretical results for causal mediation analysis. Psychological Methods, 19, 482-487. doi:10.1037/met0000021
15.
JuddC. M.KennyD. A. (1981). Process analysis: Estimating mediation in treatment evaluations. Evaluation Review, 5, 602-619. doi:10.1177/0193841X8100500502
16.
KennyD. A.JuddC. M. (2014). Power anomalies in testing mediation. Psychological Science, 25, 334-349. doi:10.1177/0956797613502676
17.
KennyD. A.KashyD. A.BolgerN. (1998). Data analysis in social psychology. In GilbertD. T.FiskeS. T.LindzeyG. (Eds.), The handbook of social psychology (4th ed., Vol. 1, pp. 233-268). Boston, MA: McGraw-Hill.
18.
KraemerH. C.KiernanM.EssexM.KupferD. J. (2008). How and why criteria defining moderators and mediators differ between the Baron & Kenny and MacArthur approaches. Health Psychology, 27 (Suppl. 2), S101-S108. doi:10.1037/0278-6133.2(Suppl.).S101
19.
KrauseM. R.SerlinR. C.WardS. E.RonyR. Y. Z.EzenwaM. O.NaabF. (2010). Testing mediation in nursing research: Beyond Baron and Kenny. Nursing Research, 59, 288-294. doi:10.1097/NNR.0b013e3181dd26b3
20.
KrullJ. L.MacKinnonD. P. (2001). Multilevel modeling of individual and group level mediated effects. Multivariate Behavioral Research, 36, 249-277. doi:10.1207/S15327906MBR3602_06
21.
LachowiczM. J.SterbaS. K.PreacherK. J. (2015). Investigating multilevel mediation with fully or partially nested data. Group Processes & Intergroup Relations, 18, 274-289. doi:10.1177/1368430214550343
22.
LevyJ. A.LandermanL. R.DavisL. L. (2011). Advances in mediation analysis can facilitate nursing research. Nursing Research, 60, 333-339. doi:10.1097/NNR.0b013e318227efca
23.
MacKinnonD. P. (2008). An introduction to statistical mediation analysis. Mahwah, NJ: Lawrence Erlbaum.
24.
MacKinnonD. P.FritzM. S.WilliamsJ.LockwoodC. M. (2007). Distribution of the product confidence limits for the indirect effect: Program PRODCLIN. Behavior Research Methods, 39, 384-389. doi:10.3758/BF03193007
25.
MacKinnonD. P.LockwoodC. M.HoffmanJ. M.WestS. G.SheetsV. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7, 83-104. doi:10.1037/1082-989X.7.1.83
26.
MaxwellS. E.ColeD. A. (2007). Bias in cross-sectional analyses of longitudinal mediation. Psychological Methods, 12, 23-44. doi:10.1037/1082-989X.12.1.23
27.
MaxwellS. E.ColeD. A.MitchellM. A. (2011). Bias in cross-sectional analyses of longitudinal mediation: Partial and complete mediation under an autoregressive model. Multivariate Behavioral Research, 46, 816-841. doi:10.1080/00273171.2011.606716
28.
MitchellM. A.MaxwellS. E. (2013). A comparison of the cross-sectional and sequential designs when assessing longitudinal mediation. Multivariate Behavioral Research, 48, 301-339. doi:10.1080/00273171.2013.784696
29.
MuthénB. O.CurranP. J. (1997). General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2, 371-402. doi:10.1037/1082-989.2.4.371
30.
PearlJ. (2014). Interpretation and identification of causal mediation. Psychological Methods, 19, 459-481. doi:10.1037/a0036434
31.
PituchK. A.StapletonL. M.KangJ. Y. (2006). A comparison of single sample and bootstrap methods to assess mediation in cluster randomized trials. Multivariate Behavioral Research, 41, 367-400. doi:10.1207/s15327906mbr4103_5
32.
PituchK. A.WhittakerT. A.StapletonL. M. (2005). A comparison of methods to test for mediation in multisite experiments. Multivariate Behavioral Research, 40, 1-23. doi:10.1207/s15327906mbr4001_1
33.
PreacherK. J.HayesA. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40, 879-891. doi:10.3758/BRM.40.3.879
34.
PreacherK. J.ZyphurM. J.ZhangZ. (2010). A general multilevel SEM framework for assessing multilevel mediation. Psychological Methods, 15, 209-233. doi:10.1037/a0020141
35.
RuckerD. D.PreacherK. J.TormalaZ. L.PettyR. E. (2011). Mediation analysis in social psychology: Current practices and new recommendations. Social and Personality Psychology Compass, 5/6, 359-371. doi:10.1111/j.1751-9004.2011.00355.x
36.
ShpitserI. (2013). Counterfactual graphical models for longitudinal mediation analysis with unobserved confounding. Cognitive Science, 37, 1011-1035. doi:10.1111/cogs.12058
37.
ShroutP. E.BolgerN. (2002). Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods, 7, 422-445. doi:10.1037/1082-989X.7.4.422
38.
Ten HaveT. R.JoffeM. M. (2012). A review of causal estimation of effects in mediation analyses. Statistical Methods in Medical Research, 21, 77-107. doi:10.1177/0962280210391076
39.
TingleyD.YamamotoT.HiroseK.KeeleL.ImaiK. (2014). Mediation: R package for causal mediation analysis. Journal of Statistical Software, 59(5), 1-38. doi:10.18637/j33.v059.i05
40.
TofighiD.ThoemmesF. (2014). Single-level and multilevel mediation analysis. Journal of Early Adolescence, 34, 93-119. doi:10.1177/0272431613511331
41.
WilliamsJ.MacKinnonD. P. (2008). Resampling and distribution of the product methods for testing indirect effects in complex models. Structural Equation Modeling, 15, 23-51. doi:10.1080/10705510701758166
42.
WoodR. E.GoodmanJ. S.BeckmannN.CookA. (2008). Mediation testing in management research: A review and proposals. Organizational Research Methods, 11, 270-295. doi:10.1177/1094428106297811
