Intervention fidelity is a critical strategy to help advance the usefulness and integrity of social work research. This study assessed the extent to which a selected sample of published social work intervention researchers reported its intervention protocols.
Methods:
Six core social work journals were reviewed in this analysis. The authors reviewed every scholarly article within each journal published from 2009 through 2013 (N = 1,380). A total of N = 32 (2.3%) published intervention research articles met the inclusion criteria. All N = 32 studies were evaluated using 11 criteria developed by the research team related to assessing the study’s treatment fidelity.
Results:
The finding suggests that although attention to treatment fidelity in social work research has increased, methodological inconsistencies still remain.
Conclusion:
Effective social work research of an intended intervention is largely dependent on the intervention’s fidelity. Implications for social work practice and research are discussed.
*References marked with an asterisk indicate studies included in the meta-analysis. The in-text citations to studies selected for meta-analysis are not preceded by asterisks.
2.
BellgA. J.BorrelliB.ResnickB.HechtJ.MinicucciD.OryM.CzajkowskiS. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH behavior change consortium. Health Psychology, 23, 443–451. doi:10.1037/0278-6133.23.5.443
3.
BondG. R.EvansL.SalyersM. P.WilliamsJ.KimH. W. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2, 75–87.
4.
BorrelliB.SepinwallD.ErnstD.BellgA. J.CzajkowskiS.BregerR.OrwigD. (2005). A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. Journal of Consulting and Clinical Psychology, 73, 852–860. doi:10.1037/0022-006X.73.5.852
5.
CarrollC.PattersonM.WoodS.BoothA.RickJ.BalainS. (2007). A conceptual framework for implementation fidelity. Implementation Science, 35, 85–101. doi:10.1186/1748-5908-2-40
6.
CenturyJ.RudnickM.FreemanC. (2010). A framework for measuring fidelity of implementation: A foundation for shared language and accumulation of knowledge. American Journal of Evaluation, 31, 199–218.
ChenH. T.RossiP. H. (1983). Evaluating with sense: The theory driven approach. Evaluation Review, 7, 283–302.
9.
*ConnerN. W.FraserM. W. (2011). Preschool Social–Emotional Skills Training a Controlled Pilot Test of the Making Choices and Strong Families Programs. Research on Social Work Practice, 21, 699–711. doi:10.1177/1049731511408115
10.
*CoulterS. (2011). Systemic family therapy for families who have experienced trauma: A randomised controlled trial. British Journal of Social Work, 41, 502–519.
11.
DaneA.SchneiderB. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control?Clinical Psychology Review, 18, 23–45.
12.
DusenburyL.BranniganR.FalcoM.HansenW. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.
13.
FixsenD. L.NaoomS. F.BlaseK. A.FriedmanR. M.WallaceF. (2005). Implementation research: A synthesis of the literature (FMHI Publication #231). Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. Retrieved fromhttp://ctndisseminationlibrary.org/PDF/nirnmonograph.pdf
14.
FraserM. W.GalinskyM. J. (2010). Steps in intervention research: Designing and developing social programs. Research on Social Work Practice, 20, 459–466.
15.
GambrillE. (2011). Evidence-based practice and the ethics of discretion. Journal of Social Work, 11, 26–48. doi:http://dx.doi.org.proxy-remote.galib.uga.edu/10.1177/1468017310381306
16.
GearingR. E.El-BasselN.GesquiereA.BaldwinS.GilliesJ.NgeowE. (2011). Major ingredients of fidelity: A review and scientific guide to improving quality of intervention research implementation. Clinical Psychology Review, 31, 79–88.
17.
GibbsL.GambrillE. (2002). Evidence-based practice: Counterarguments to objections. Research on Social Work Practice, 12, 452–476.
18.
GidyczC. A.LynnS. J.RichC. L.MarioniN. L.LohC.BlackwellL. M.MarioN. L. (2001). The evaluation of a sexual assault risk reduction program: A multisite investigation. Journal of Consulting and Clinical Psychology, 69, 1073–1078.
19.
GreshamF.GansleK.NoellG. (1993). Treatment integrity in applied behavior analysis with children. Journal of Applied Behavior Analysis, 2, 257–263.
20.
*HallJ. A.SarrazinM. S. V.HuberD. L.VaughnT.BlockR. I.ReedyA. R.JangM. (2009). Iowa case management for rural drug abuse. Research on Social Work Practice, 19, 407–422. doi:10.1177/1049731509331925
21.
HodgeD. R.LacasseJ. R.BensonO. (2012). Influential publications in social work discourse: The 100 most highly cited articles in disciplinary journals: 2000–09. British Journal of Social Work, 42, 765–782.
22.
HoloskoM. J. (2006). A suggested authors’ checklist for submitting manuscripts to Research on Social Work Practice. Research on Social Work Practice, 16, 449–454.
23.
HoloskoM. J. (2009). What types of designs are we using in social work research and evaluation?Research on Social Work Practice, 20, 665–673.
24.
HoloskoM. J.LeslieD. (1998). Obstacles to conducting empirically based practice. In WodarskiJ.ThyerB. (Eds.), Handbook of empirical social work practice issues (Vol. 2, pp. 433–453). New York, NY: John Wiley.
25.
HoloskoM. J.ThyerB. (2011). Pocket glossary for commonly used research terms. Thousand Oaks, CA: Sage.
26.
HoloskoM. J.ThyerB.DannerJ. E. (2009). Ethical guidelines for designing and conducting evaluations of social work practice. Journal of Evidence-Based Social Work, 6, 348–360.
27.
*JacobsonJ. M.OsteenP. J.SharpeT. L.PastoorJ. B. (2012). Randomized trial of suicide gatekeeper training for social work students. Research on Social Work Practice, 22, 270–281. doi:10.1177/1049731511436015
28.
*JonesL. V. (2009). Claiming your connections: A psychosocial group intervention study of black college women. Social Work Research, 33, 159–171.
29.
*KayserK.FeldmanB. N.BorstelmannN. A.DanielsA. A. (2010). Effects of a randomized couple-based intervention on quality of life of breast cancer patients and their partners. Social Work Research, 34, 20–32.
30.
*LanghorstD. M.ChoiY. J.Keyser-MarcusL.SvikisD. S. (2012). Reducing sexual risk behaviors for HIV/STDs in women with alcohol use disorders. Research on Social Work Practice, 22, 367–379. doi:10.1177/1049731512441683
31.
*LanierP.KohlP. L.BenzJ.SwingerD.MoussetteP.DrakeB. (2011). Parent-child interaction therapy in a community setting: examining outcomes, attrition, and treatment setting. Research on Social Work Practice, 21, 689–698. doi:10.1177/1049731511406551
32.
*LeitchM. L.VanslykeJ.AllenM. (2009). Somatic experiencing treatment with social service workers following Hurricanes Katrina and Rita. Social Work, 54, 9–18.
33.
*LeungC.TsangS.HeungK.YiuI. (2009). Effectiveness of Parent-child Interaction Therapy (PCIT) among Chinese families. Research on Social Work Practice, 19, 304–313. doi:10.1177/1049731508321713
34.
MaynardB.PetersK.VaughnM.SarteschiC. (2013). Fidelity in after-school program intervention research: A systematic review. Research on Social Work Practice, 23, 613–623. doi:10.1177/1049731513491150
35.
McArthurB.RiosaP.PreydeM. (2012). Treatment fidelity in psychosocial intervention for children and adolescents with comorbid problems. Child & Adolescent Mental Health, 17, 139–145.
36.
McNeeceC.ThyerB. A. (2004). Evidence-based practice and social work. Journal of Evidence-Based Social Work, 1, 5–23. doi:10.1300/J394v01n0102
37.
McRoyR. G.FlanzerJ. P.ZlotnikJ. L. (2012). Building research culture and infrastructure. New York, NY: Oxford University Press.
38.
MoncherF. J.PrinzR. J. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247–266.
39.
MowbrayC. T.HolterM. C.TeagueG. B.BybeeD. (2003). Fidelity Criteria: Development, measurement, and validation. American Journal of Evaluation, 24, 315–340. doi:10.1016/S1098-2140(03)00057-2
40.
NaleppaM. J.CagleJ. G. (2010). Treatment fidelity in social work intervention research: A review of published studies. Research on Social Work Practice, 20, 674–681.
41.
*PainterK. (2009). Multisystemic therapy as community-based treatment for youth with severe emotional disturbance. Research on Social Work Practice, 19, 314–324. doi:10.1177/1049731508318772
42.
PerepletchikovaF.KazdinA. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365−383.
43.
RubinA.ParrishD. (2007). Problematic phrases in the conclusions of published outcome studies: Implications for evidence-based practice. Research on Social Work Practice, 17, 334–347.
44.
SalendS. J. (1984). Integrity of treatment in special education research. Mental Retardation, 22, 309–315.
45.
ShawI. (2005). Is social work research distinctive?Social Work Education, 26, 659–669.
46.
*ShinS. K. (2009). Effects of a solution-focused program on the reduction of aggressiveness and the improvement of social readjustment for Korean youth probationers. Journal of Social Service Research, 35, 274–284.
47.
SilberschatzG.FretterP. B.CurtisJ. T. (1986). How do interpretations influence the process of psychotherapy?Journal of Consulting and Clinical Psychology, 54, 646–652.
48.
*StrileyC. W.NattalaP. P.AbdallahA. B.DennisM. L.CottlerL. B. (2013). Enhanced case management versus substance abuse treatment alone among substance abusers with depression. Social Work Research, 37, 19–25.
49.
SummerfeltW. T. (2003). Program strength and fidelity in evaluation. Applied Developmental Science, 7, 55–61.
50.
ThyerB. A.MyersL. L. (2007). A social worker’s guide to evaluating practice outcomes. Alexandria, VA: Council on Social Work Education.
51.
*TimmerS. G.ZebellN. M.CulverM. A.UrquizaA. J. (2010). Efficacy of adjunct in-home coaching to improve outcomes in parent—child interaction therapy. Research on Social Work Practice, 20, 36–45. doi:10.1177/1049731509332842
52.
TuckerA. R.BlytheB. (2008). Attention to treatment fidelity in social work outcomes: A review of the literature from the 1990s. Social Work Research, 32, 185–190.
53.
*ValdezA.CepedaA.ParrishD.HorowitzR.KaplanC. (2013). An adapted brief strategic family therapy for gang-affiliated Mexican American adolescents. Research on Social Work Practice, 23, 383–396. doi:10.1177/1049731513481389
54.
WaltzJ.AddisM. E.KoernerK.JacobsonN. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630. doi:10.1037/0022-006X.61.4.620
55.
WodarskiJ. S. (2011). The social work practice research conundrum. Journal of Human Behavior in the Social Environment, 21, 577–600. doi:10.1080/10911359.2011.580249
56.
*Zajicek-FarberM. L. (2010). Building practice evidence for parent mentoring home visiting in early childhood. Research on Social Work Practice, 20, 46–64. doi:10.1177/1049731509333172
