Despite a call for evidence-based practice in school psychology, limited research on the topic of evidence-based assessment exists. To begin to address this gap in the research, a modified version of Jenson–Doss and Hawley’s (2010) Attitudes Toward Standardized Assessment (ASA) scale was administered to 371 U.S. school psychologists. Examination of the modified ASA’s factor structure suggested that a bifactor model with a single overall domain and three sub-domains was the most parsimonious. Indices of dimensionality indicated that the overall score may be the best indicator of school psychologist’s perceptions of standardized assessment. Additionally, school psychologists’ reported favorable attitudes of standardized assessment compared to clinical judgment alone. Limitations and implications for future research are discussed.
BenjaminiY.,HochbergY. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
6.
BensonN. F.FloydR. G.KranzlerJ. H.EckertT. L.FeferS. A.MorganG. B. (2019). Test use and assessment practices of school psychologists in the United States: Findings from the 2017 National Survey. Journal of School Psychology, 72, 29–48. https://doi.org/10.1016/j.jsp.2018.12.004
7.
BensonN.LockwoodA.FarmerR. (2021, August). National survey of training and assessment practices. Presented at the American Psychological Association (APA), Annual Convention, Virtual.
8.
BiancoM. (2005). The effects of disability labels on special education and general education teachers’ referrals for gifted programs. Learning Disability Quarterly, 28(4), 285–293. https://doi.org/10.2307/4126967
9.
BiancoM.,LeechN. L. (2010). Twice-exceptional learners: Effects of teacher preparation and disability labels on gifted referrals. Teacher Education and Special Education, 33(4), 319–334. https://doi.org/10.1177/0888406409356392
10.
CookJ. M.SchnurrP. P.BiyanovaT.CoyneJ. C. (2009). Apples don’t fall far from the tree: Influences on psychotherapists’ adoption and sustained use of new therapies. Psychiatric Services, 60(5), 671–676. https://doi.org/10.1176/appi.ps.60.5.671
11.
CooperG.BarkatsasT.StrathdeeR. (2019). The theory of planned behaviour (TPB) in educational research using structural equation modelling (SEM)BarkatsasT.BertramA., (Eds.), (Vol. 1, pp. 139–162). Brill Sense.
12.
DillmanD. A.SmythJ. D.ChristianL. M. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method (4th ed.). Wiley.
13.
DombrowskiS. C.McGillR. J.FarmerR. L.KranzlerJ. H.CanivezG. L. (2021). Beyond the rhetoric of evidence-based assessment: A framework for critical thinking in clinical practice. School Psychology Review. Advance online publication. https://doi.org/10.1080/2372966X.2021.1960126
14.
EysenbachG. (2004). Improving the quality of web surveys: The checklist for reporting results of internet e-surveys (CHERRIES). Journal of Medical Internet Research, 6(3), e34. https://doi.org/10.2196/jmir.6.3.e34
GrossT. J.FarmerR. L.OchsS. E. (2019). Evidence-based assessment: Best practices, customary practices, and recommendations for field-based assessment. Contemporary School Psychology, 23(3), 304–326. https://doi.org/10.1007/s40688-018-0186-x
18.
HigginsE. L.RaskindM. H.GoldbergR. J.HermanK. L. (2002). Stages of acceptance of a learning disability: The impact of labeling. Learning Disability Quarterly, https://doi.org/10.2307/1511187
19.
HojnoskiR. L.MorrisonR.BrownM.MatthewsW. J. (2006). Projective test use among school psychologists: A survey and critique. Journal of Psychoeducational Assessment, 24(2), 145–159. https://doi.org/10.1177/0734282906287828
20.
HunsleyJ.LeeC. M.WoodJ. M.TaylorW. (2015). Controversial and questionable assessment techniques. In LilienfeldS. O.LynnS. J.LohrJ. M. (Eds.), Science and pseudoscience in clinical psychology (pp. 42–82). The Guilford Press.
21.
Jensen-DossA.HaimesE. M. B.SmithA. M.LyonA. R.LewisC. C.StanickC. F.HawleyK. M. (2018). Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Administration and Policy in Mental Health and Mental Health Services Research, 45(1), 48–61. https://doi.org/10.1007/s10488-016-0763-0
22.
Jensen-DossA.,HawleyK. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child & Adolescent Psychology, 39(6), 885–896. https://doi.org/10.1080/15374416.2010.517169
23.
Jensen-DossA.,HawleyK. M. (2011). Understanding clinicians’ diagnostic practices: Attitudes toward the utility of diagnosis and standardized diagnostic tools. Administration and Policy in Mental Health and Mental Health Services Research, 38(6), 476–485. https://doi.org/10.1007/s10488-011-0334-3
24.
JimersonS. R.StewartK.SkokutM.CardenasS.MaloneH. (2009). How many school psychologists are there in each country of the world?: International estimates of school psychologists and school psychologist-to-student ratios. School Psychology International, 30(6), 555–567. https://doi.org/10.1177/0143034309107077
KranzlerJ. H.MakiK. E.BensonN. F.EckertT. L.FloydR. G.FeferS. A. (2020). How do school psychologists interpret intelligence tests for the identification of specific learning disabilities?Contemporary School Psychology, 24(4), 445–456. https://doi.org/10.1007/s40688-020-00274-0
27.
KratochwillT. R.,StoiberK. C. (2002). Evidence-based interventions in school psychology: Conceptual foundations of the Procedural and Coding Manual of Division 16 and the Society for the Study of School Psychology Task Force. School Psychology Quarterly: The Official Journal of the Division of School Psychology, American Psychological Association, 17(4), 341. https://psycnet.apa.org/record/2003-01789-005
28.
LeeJ.CerretoF. A.LeeJ. (2010). Theory of planned behavior and teachers’ decisions regarding use of educational technology. Journal of Educational Technology & Society, 13(1), 152–164. http://www.jstor.org/stable/jeductechsoci.13.1.152.
29.
LewisM. F.TruscottS. D.VolkerM. A. (2008). Demographics and professional practices of school psychologists: A comparison of NASP members and non–NASP school psychologists by telephone survey. Psychology in the Schools, 45(6), 467–482. https://doi.org/10.1002/pits.20317
30.
LilienfeldS. O.LynnS. J.BowdenS. C. (2018). Why evidence-based practice isn’t enough: A call for science-based practice. The Behavior Therapist/AABT, 41(1), 42–47. https://doi.org/10.1037/pro0000235
LockwoodA.BensonN.FarmerR.KlatkaK. (2022). Test use and assessment practices of school psychology training programs: Findings from a 2020 survey of U.S. faculty. Psychology in the Schools. https://doi.org/10.1002/pits.22639.
33.
LockwoodA. B.,FarmerR. L. (2020). The cognitive assessment course: Two decades later. Psychology in the Schools, 57(2), 265–283. https://doi.org/10.1002/pits.22298
34.
LockwoodA. B.GrossT. J.FarmerR. L.LokeS. W. (2019). Huber inventory of trainee self-efficacy: Assessment of measurement models. Psychology in the Schools, 56(6), 992–1003. https://doi.org/10.1002/pits.22230
35.
MacFarlaneK.,WoolfsonL. M. (2013). Teacher attitudes and behavior toward the inclusion of children with social, emotional and behavioral difficulties in mainstream schools: An application of the theory of planned behavior. Teaching and Teacher Education, 29, 46–52. https://doi.org/10.1016/j.tate.2012.08.006
36.
McGillR. J. (2019). Evidence-based assessment in school psychology: An introduction. Contemporary School Psychology, 23(2), 113–114. https://doi.org/10.1007/s40688-019-00240-5
37.
McGillR. J.DombrowskiS. C.CanivezG. L. (2018). Cognitive profile analysis in school psychology: History, issues, and continued concerns. Journal of School Psychology, 71, 108–121. https://doi.org/10.1016/j.jsp.2018.10.007
38.
MillerL. T.BumpusE. C.GravesS. L. (2020). The state of cognitive assessment training in school psychology: An analysis of syllabi. Contemporary School Psychology. Advance online publication. https://doi.org/10.1007/s40688-020-00305-w
39.
MinnerS. (1989). Initial referral recommendations of teachers toward gifted students with behavioral problems. Roeper Review, 12(2), 78–80. https://doi.org/10.1080/02783198909553240
MontiniT.,GrahamI. D. (2015). “Entrenched practices and other biases”: Unpacking the historical, economic, professional, and social resistance to de-implementation. Implementation Science: IS, 10, 24. https://doi.org/10.1186/s13012-015-0211-7
National Association of School Psychologists. (2016). School psychologists’ involvement in assessment (Position Statement). Bethesda, MD: National Association of School Psychologists. https://www.nasponline.org/x36851.xml
National Association of School Psychologists (NASP). (1986). Rights without labels: A position statement. Executive Board / Delegate Assembly of the National Association of School Psychologists.
NorcrossJ. C.BeutlerL. E.LevantR. F. (2006). Evidence-based practices in mental health: Debate and dialogue on the fundamental questions.American Psychological Association.
48.
NultyD. D. (2008). The adequacy of response rates to online and paper surveys: What can be done?Assessment & Evaluation in Higher Education, 33(3), 301–314. https://doi.org/10.1080/02602930701293231
49.
ReiseS. P.BonifayW. E.HavilandM. G. (2013a). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129–140. https://doi.org/10.1080/00223891.2012.725437
50.
ReiseS. P.MooreT. M.HavilandM. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92(6), 544–559. https://doi.org/10.1080/00223891.2010.496477
51.
ReiseS. P.ScheinesR.WidamanK. F.HavilandM. G. (2013b). Multidimensionality and structural coefficient bias in structural equation modeling: A bifactor perspective. Educational and Psychological Measurement, 73(1), 5–26. https://doi.org/10.1177/0013164412449831
RolisonM. A.,MedwayF. J. (1985). Teachers’ expectations and attributions for student achievement: Effects of label, performance pattern, and special education intervention. American Educational Research Journal, 22(4), 561–573. https://doi.org/10.3102/00028312022004561
54.
RosseelY. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
55.
RStudio Team. (2020). RStudio: Integrated development for R. RStudio. http://www.rstudio.com/
56.
Sotelo-DynegaM.,DixonS. G. (2014). Cognitive assessment practices: A survey of school psychologists. Psychology in the Schools, 51(10), 1031–1045. https://doi.org/10.1002/pits.21802
57.
StuckyB. D.,EdelenM. O. (2014). Using hierarchical IRT models to create unidimensional measures from multidimensional data. In ReiseS. P.RevickiD. A. (Eds.). Handbook of item response theory modeling: Applications to typical performance assessment (pp. 183-206). Routledge/Taylor & Francis Group.
58.
SwannW.,SnyderM. (1980). On translating beliefs into action: Theories of ability and their application in an instructional setting. Journal of Personality and Social Psychology, 38(6), 879–888. https://doi.org/10.1037/0022-3514.38.6.879
WatkinsM. W. (2017). The reliability of multidimensional neuropsychological measures: from alpha to omega. The Clinical Neuropsychologist, 31(6-7), 1113–1126. https://doi.org/10.1080/13854046.2017.1317364
61.
WoodcockS.,VialleW. (2011). Are we exacerbating students’ learning disabilities? An investigation of preservice teachers’ attributions of the educational outcomes of students with learning disabilities. Annals of Dyslexia, 61(2), 223–241. https://doi.org/10.1007/s11881-011-0058-9
62.
YoshidaK.ChipmanJ. J.BohnJ.McGowanL. D.BarrettM.ChristensenR. H. B. (2020). Create “Table 1” to describe baseline characteristics with or without propensity score weight. (0.12.0)[Computer software]. https://github.com/kaz-yos/tableone
63.
YoungstromE. A. (2013). Future directions in psychological assessment: combining evidence-based medicine innovations with psychology’s historical strengths to enhance utility. Journal of Clinical Child and Adolescent Psychology, 42(1), 139–159. https://doi.org/10.1080/15374416.2012.736358
64.
YoungstromE. A.,Van MeterA. (2016). Empirically supported assessment of children and adolescents. Clinical Psychology: Science and Practice, 23(4), 327–347. https://doi.org/10.1111/cpsp.12172
65.
ZintM. (2002). Comparing three attitude-behavior theories for predicting science teachers’ intentions. Journal of Research in Science Teaching, 39(9), 819–844. https://doi.org/10.1002/tea.10047
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
