Purpose: The purpose of this study is to develop and validate a social work evaluation competence scale for social work program evaluation in China. Method: We generated dimensions and items through a thorough literature review, confirmed by experts, and indigenized by scholars and evaluation practitioners. The sample sourced from eight cities in China. We employed exploratory factor analysis to examine the preliminary structure of the scale (N = 135) and confirmatory factor analysis, convergent validity, discriminant validity to examine validity (N = 256). Results: Social work evaluation competence scale, consisting of six dimensions with 37 items, demonstrates good quality of internal consistency, satisfactory factorial validity, convergent validity, discriminant validity, and criterion validity. Discussion: The six-dimension social work evaluation competence scale is a reliable and valid instrument. It provides a quantitative basis for measuring the competences of social work program evaluators, and functions as a tool to guide competence training for social work program evaluators.
BrownT. (2006). Confirmatory factor analysis for applied research. Guilford Press.
7.
CheethamG.ChiversG. (1996). Towards a holistic model of professional competence. Journal of European Industrial Training, 20(5), 20–30. https://doi.org/10.1108/03090599610119692
8.
CheethamG.ChiversG. (1998). The reflective (and competent) practitioner: A model of professional competence which seeks to harmonise the reflective practitioner and competence-based approaches. Journal of European Industrial Training, 22(7), 267–276. https://doi.org/10.1108/03090599810230678
DuJ.KouH. L. (2023). Constructing the core competence model of online teaching for primary and secondary school teachers. Chinese Education Informationization, 29(9), 119–128. https://doi.org/10.3969/j.issn.1673-8454.2023.09.014[Chinese].
13.
GagnéP.HancockG. (2006). Measurement model quality, sample size, and solution propriety in confirmation factor models. Multi-variate Behavioral Research, 41(1), 65–83. https://doi.org/10.1207/s15327906mbr4101_5
14.
GoncziA. (1999). Competency-based learning: A dubious past—An assured future? In BoudD.GarrickJ. (Eds.), Understanding learning at work (pp. 188–196). Routledge.
15.
GubaE. G.LincolnY. S. (1989). Fourth generation evaluation. Sage.
16.
GuoL.GuoZ. X.JiaH. T., et al. (2023). Electricity theft identification among residents based on Pearson correlation coefficient and SVM. Journal of Hebei University (Natural Science Edition), 43(4), 357–363. https://doi.org/10.3969/j.issn.1000-1565.2023.04.003.[Chinese]
17.
HuL.BentlerP. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
18.
LaughlinR.BrodbentJ. (1996). Redesigning fourth generation evaluation: An evaluation model for the public sector reforms in the UK. Evaluation, 2(4), 431–452. https://doi.org/10.1177/135638909600200406
19.
LiuF. Z. (2006). The development of middle management competency measurement scale in Maoming petrochemical. [Master's thesis, South China University of Technology]. [Chinese].
20.
LiuJ.ChenL. (2022). Development and validation of a Chinese standardized client satisfaction scale. Research on Social Work Practice, 32(8), 1019–1031. https://doi.org/10.1177/10497315221109213
21.
McClellandD. C. (1973). Testing for competence rather than for intelligence. Joumal of American Psycholologist, 28(1), l–14. https://doi.org/10.1037/h0034092
22.
MulderM. (2014). Conceptions of professional competence. In BillettS.HarteisC.GruberH. (Eds.), International handbook on research into professional and practice-based learning (pp. 107–137). Springer.
23.
MulderM.WeigelT.CollinsK. (2007). The concept of competence in the development of vocational education and training in selected EU member states: A critical analysis. Journal of Vocational Education and Training, 59(1), 67–88. https://doi.org/10.1080/13636820601145630
24.
PloumL.BlokV.LansT.OmtaO. (2018). Toward a validated competence framework for sustainable entrepreneurship. Organization & Environment, 31(2), 113–132. https://doi.org/10.1177/1086026617697039
25.
RossiP. H.FreemanH. E. (1989). Evaluation: A systematic approach. Sage.
SpencerL. M.SpencerS. M. (1993). Competence at work: Models for superior performance. Wiley.
28.
StufflebeamD. L.ShinklefieldA. J. (1985). Systematic evaluation. Kluwer-Nijhoff Publishing.
29.
TorrA. (2008). A complex view of professional competence. In Proceedings of the 17th National Vocational Education and Training Research Conference ‘No Frills’ (pp. 185–193). National Centre for Vocational Education Research. https://www.ncver.edu.au/__data/assets/file/0026/4998/torr-2008.pdf
WangY.ChuiE. (2017). Development and validation of the Perceived Social Work Competence Scale (PSWCS) in China. Research on Social Work Practice, 27(1), 91–102. https://doi.org/10.1177/1049731516631119
WesselinkR.De JongC.BiemansH. J. A. (2010). Aspects of competence-based education as foot holds to improve the connectivity between learning in school and in the workplace. Vocations and Learning, 3(1), 19–38. https://doi.org/10.1007/s12186-009-9027-4
