Objectives: To evaluate an objective structured clinical examination (OSCE) adapted for social work in a lab course and examine the degree to which it predicts competence in the practicum. Method: 125 Masters students participated in a one-scenario OSCE and wrote responses to standardized reflection questions. OSCE performance and reflections were rated on previously standardized scales, competence in field was evaluated using the online practice-based evaluation. Results: A wide range of scores on OSCE scales indicate that differences in student competencies were captured. Correlational analyses revealed an association between OSCE scales and field final evaluations. Nevertheless, a number of students who performed poorly on the OSCE did well in the practicum. Conclusions: The OSCE method of evaluation warrants cautious optimism and requires further replication and adaptation for social work educational outcomes assessment.
ACGME. (2010). Outcome project: Common program requirements: General competencies. Chicago, IL: Author.
2.
AustinZ.O'ByrneC.PugsleyJ.Quero MunozL. (2003). Development and validation processes for an objective structured clinical examination (OSCE) for entry-to-practice certification in pharmacy: The Canadian experience. American Journal of Pharmaceutical Education, 67, 76.
3.
BogoM.RegehrC.LogieC.KatzE.MylopoulosM.RegehrG. (2011). Adapting objective structured clinical examinations to assess social work students’ performance and reflections. Journal of Social Work Education, 47, 5–18.
4.
BogoM.RegehrC.PowerR.HughesJ.WoodfordM.RegehrG. (2004). Toward new approaches for evaluating student field performance: Tapping the implicit criteria used by experienced field instructors. Journal of Social Work Education, 40, 417–426.
5.
BogoM.RegehrC.PowerR.RegehrG. (2007). When values collide: Providing feedback and evaluating competence in social work. Clinical Supervisor, 26, 99–117.
6.
BogoM.RegehrC.WoodfordM.HughesJ.PowerR.RegehrG. (2006). Beyond competencies: Field instructors’ descriptions of student performance. Journal of Social Work Education, 42, 191–205.
FouadN. A.HatcherR. L.HutchingsP. S.CollinsF. L.Jr.GrusC. L.KaslowN. J.CrossmanR. E. (2009). Competency benchmarks: A model for understanding and measuring competence in professional psychology across training levels. Training and Education in Professional Psychology, 3, S5–S26.
9.
GambrillE. (2001). Evaluating the quality of social work education: Options galore. Journal of Social Work Education, 37, 418–429.
10.
HackettS. (2001). Educating for competency and reflective practice: Fostering a conjoint approach in education and training. Journal of Workplace Learning, 13, 103–112.
11.
HardenR. M.GleesonF. A. (1979). Assessment of clinical competence using an observed structured clinical examination. Medical Education, 13, 41–47.
12.
HodgesB. D. (2006). The objective structured clinical examination: Three decades of development. Journal of Veterinary Medical Education, 33, 571–577.
13.
KaslowN. J.BordenK. A.CollinsF. L.ForrestL.Illfelder-KayeJ.NelsonP. D.& RalloJ. S. (2004). Competencies conference: Future directions in education and credentialing in professional psychology. Journal of Clinical Psychology, 60, 699–712.
14.
KaslowN. J.RubinN. J.BebeauM. J.LeighI. W.LichtenbergJ. W.NelsonP. D.SmithI. L. (2007). Guiding principles and recommendations for the assessment of competence. Professional Psychology: Research and Practice, 38, 441–451.
15.
KellyJ.HorderW. (2001). The how and why: Competences and holistic practice. Social Work Education, 20, 689–699.
16.
LeungW. C. (2002). Competency based medical training: Review. British Journal of Medicine, 325, 693–695.
17.
LogieC.BogoM.RegehrC.RegehrG. (in press). The use of standardized clients in social work education: A critical synthetic review. Journal of Social Work Education.
18.
LuY. E.AinE.ChamorroC.ChangC.FengJ. Y.FongR.YuM. (2011). A new methodology for assessing social work practice: The adaptation of the objective structured clinical evaluation (SW-OSCE). Social Work Education, 30, 170–185.
19.
LurieS. J.MooneyC. J.LynessJ. M. (2009). Measurement of the general competencies of the accreditation council for graduate medical education: A systematic review. Academic Medicine, 84, 301–309.
20.
MaidmentJ. (2000). Methods used to teach social work students in the field: A research report from New Zealand. Social Work Education, 19, 145–154.
21.
National Association of Social Workers. (2007). The indicators for the achievement of the NASW standards for cultural competence in the social work profession. Washington, DC: NASW Press.
22.
RawlingsM. (2008). Assessing direct practice skill performance in undergraduate social work education using standardized clients and self-reported self-efficacy. Cleveland, OH: Case Western Reserve.
23.
RegehrC.BogoM.DonovanK.LimA.RegehrG. (2011). Evaluating a scale to measure student competencies in macro social work practice. Journal of Social Service Research, 38(1), (1)100–109.
24.
RegehrC.BogoM.RegehrG. (2011). Development of an online practice-based evaluation tool for social work. Research on Social Work Practice, 21, 469–475.
25.
RegehrG.BogoM.RegehrC.PowerR. (2007). Can we build a better mousetrap? Improving measures of social work practice performance in the field. Journal of Social Work Education, 43, 327–343.
26.
RogersG.McDonaldP. L. (1995). Expedience over education: Teaching methods used by field instructors. Clinical Supervisor, 13, 41–65.
27.
SnellL. S.FrankJ. R. (2010). Competencies, the tea bag model, and the end of time. Medical Teacher, 32, 629–630.
28.
SowbelL. R. (2011). Gatekeeping in field performance: Is grade inflation a given?Journal of Social Work Education, 47, 367–377.
29.
WatsonR.StimpsonA.ToppingA.PorockD. (2002). Clinical competence assessment in nursing: A systematic review of the literature. Journal of Advanced Nursing, 39, 421–431.
30.
WesselJ.WilliamsR.FinchE.GemusM. (2003). Reliability and validity of an objective structured clinical examination for physical therapy students. Journal of Allied Health, 32, 266–269.
