The current study examined the incremental validity of the clinical clusters from the Woodcock–Johnson III Tests of Cognitive Abilities (WJ-III COG) for predicting scores on the Woodcock–Johnson III Tests of Achievement (WJ-III ACH). All participants were children and adolescents (N = 4,722) drawn from the nationally representative WJ-III standardization sample. Hierarchical multiple regression analyses were used to assess for cluster-level effects after controlling for the variance accounted for by the General Intellectual Ability (GIA) composite score. Consistent with previous studies, the GIA accounted for clinically significant portions of WJ-III ACH score variance in all of the regression models with R2 values ranging from .33 to .63. The clinical cluster scores collectively accounted for small to moderate incremental effects with no meaningful effects observed for individual indicators. Potential implications of these results for empirically supported interpretation of the WJ-III COG are discussed.
BrownR. T.ReynoldsC. R.WhitakerJ. S. (1999). Bias in mental testing since Bias in Mental Testing. School Psychology Quarterly, 14, 208-238. doi:10.1037/h0089007
2.
CanivezG. L. (2013). Incremental criterion validity of the WAIS-IV factor index scores: Relationships with WIAT-II and WIAT-III subtest and composite scores. Psychological Assessment, 25, 484-495. doi:10.1037/a0032092
3.
CizekG. J. (2003). Review of the Woodcock-Johnson III. In PlakeB. S.ImparaJ. C. (Eds.), The fifteenth mental measurements yearbook (pp. 10240-11024). Lincoln, NE: Buros Institute of Mental Measurements.
4.
CohenJ. (1988). Statistical power analysis for the behavior sciences (2nd ed.). New York, NY: Psychology Press.
5.
CohenJ.CohenP.WestS. G.AikenL. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum.
6.
DanaJ.DawesR. M. (2007). Comment on Fiorello et al. “Interpreting intelligence test results for children with disabilities: Is global intelligence relevant?Applied Neuropsychology, 14, 21-25. doi:10.1080/09084280701280379
7.
DombrowskiS. C. (2013). Investigating the structure of the WJ-III cognitive at school age. School Psychology Quarterly, 28, 154-169. doi:10.1037/spq0000010
8.
DombrowskiS. C. (2014a). Exploratory bifactor analysis of the WJ-III cognitive in adulthood via the Schmid-Leiman procedure. Journal of Psychoeducational Assessment, 32, 330-341. doi:10.1177/0734282913508243
9.
DombrowskiS. C. (2014b). Investigating the structure of the WJ-III cognitive in early school age through two exploratory bifactor analysis procedures. Journal of Psychoeducational Assessment, 32, 483-494. doi:10.1177/0734282914530838
10.
DombrowskiS. C.WatkinsM. W. (2013). Exploratory and higher-order factor analysis of the WJ-III full-test battery: A school-aged analysis. Psychological Assessment, 25, 442-455. doi:10.1037/a0031335
11.
EvansJ. J.FloydR. G.McGrewK. S.LeforgeeM. H. (2001). The relations between measures of Cattell–Horn–Carroll (CHC) cognitive abilities and reading achievement during childhood and adolescence. School Psychology Review, 31, 246-262. Available from http://www.nasponline.org
12.
FloydR. G.BergeronR.HamiltonG.ParraG. R. (2010). How do executive functions fit with the CHC model? Some evidence from a joint factor analysis of the Delis–Kaplan Executive Function System and the WJ III Tests of Cognitive Abilities. Psychology in the Schools, 27, 721-738. doi:10.1002/pits.20500
13.
FloydR. G.EvansJ. J.McGrewK. S. (2003). Relations between measures of Cattell–Horn–Carroll (CHC) cognitive abilities and mathematics achievement across the school-age years. Psychology in the Schools, 40, 155-171. doi:10.1002/pits.10083
14.
FloydR. G.McCormackA. C.IngramE.DavisA.BergeronR.HamiltonG. (2006). Relations between the Woodcock–Johnson III clinical clusters and measures of executive functions. Journal of Psychoeducational Assessment, 24, 303-317. doi:10.1177/0734282906287823
15.
FloydR. G.McGrewK. S.EvansJ. J. (2008). The relative contributions of the Cattell–Horn–Carroll (CHC) cognitive abilities in explaining writing achievement during childhood and adolescence. Psychology in the Schools, 45, 132-144. doi:10.1002/pits.20284
16.
FrazierT. W.YoungstromE. A. (2007). Historical increase in the number of factors measured by commercial Tests of Cognitive Ability: Are we overfactoring?Intelligence, 35, 169-182. doi:10.1016/j.intell.2006.07.002
17.
GluttingJ. J.WatkinsM. W.KonoldT. R.McDermottP. A. (2006). Distinctions without a difference: The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. Journal of Special Education, 40, 103-114. doi:10.1177/00224669060400020101
18.
JohnsonE. S.HumphreyM.MellardD. F.WoodsK.SwansonH. L. (2010). Cognitive processing deficits and students with specific learning disabilities: A selective meta-analysis of the literature. Learning Disability Quarterly, 33, 3-18. doi:10.1177/073194871003300101
19.
MatherN.WoodcockR. W. (2001). Woodcock–Johnson III Tests of Cognitive Abilities examiner’s manual. Itasca, IL: Riverside.
20.
McGillR. J.BusseR. T. (2014, February). Incremental validity of the Woodcock–Johnson III Tests of Cognitive Abilities stratum II factor scores. Poster presented at the annual meeting of the National Association of School Psychologists, Washington, DC.
21.
McGrewK. S.SchrankF. A.MatherN. (2014, February). Contemporary CHC theory and assessment practice: The Woodcock–Johnson IV. Workshop presented at the National Association of School Psychologists, Washington, DC.
22.
McGrewK. S.SchrankF. A.WoodcockR. W. (2007). Woodcock–Johnson III normative update technical manual. Rolling Meadows, IL: Riverside.
23.
McGrewK. S.WoodcockR. W. (2001). Woodcock–Johnson III technical manual. Itasca, IL: Riverside.
24.
NelsonJ. M.CanivezG. L. (2012). Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Scales (RIAS) with a clinical sample. Psychological Assessment, 24, 129-140. doi:10.1037/a0024878
25.
NelsonJ. M.CanivezG. L.WatkinsM. W. (2013). Structural and incremental validity of the Wechsler Adult Intelligence Scale–Fourth Edition with a clinical sample. Psychological Assessment, 25, 618-630. doi:10.1037/a0032086
26.
ReiseS. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696. doi:10.1080/00273171.2012.715555
27.
SandovalJ. (2003). Review of the Woodcock–Johnson III. In PlakeB. S.ImparaJ. C. (Eds.), The fifteenth mental measurements yearbook (pp. 1024-1028). Lincoln, NE: Buros Institute of Mental Measurements.
28.
SchaferJ. L.GrahamJ. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147-177. doi:10.1037//1082-989X.7.2.147
29.
SchneiderW. J. (2008). Playing statistical Ouija board with communality analysis: Good questions, wrong assumptions. Applied Neuropsychology, 15, 44-53. doi:10.1080/09084280801917566
30.
SchneiderW. J. (2013). Principles of assessment of aptitude and achievement. In SaklofskeD. H.ReynoldsC. R.SchweanV. L. (Eds.), The Oxford handbook of child psychological assessment (pp. 286-330). New York, NY: Oxford University Press.
31.
SchrankF. A.FlanganD. P.WoodcockR. W.MascoloJ. T. (2002). Essentials of WJ III cognitive abilities assessment. New York, NY: Wiley.
32.
SchrankF. A.MillerD. C.WendlingB. J.WoodcockR. W. (2010). Essentials of WJ III cognitive abilities assessment (2nd ed.). Hoboken, NJ: Wiley.
33.
StraussE.ShermanE. M.SpreenO. (2006). Woodcock–Johnson III Tests of Cognitive Abilities (WJ III COG). In StraussE.ShermanE. M.SpreenO. (Eds.), A compendium of neuropsychological tests: Administration, norms, and commentary (pp. 351-362). New York, NY: Oxford University Press.
34.
TaubG. E.McGrewK. S. (2014). The Woodcock–Johnson Tests of Cognitive Abilities III’s cognitive performance model: Empirical support for intermediate factors within CHC theory. Journal of Psychoeducational Assessment, 32, 187-201. doi:10.1177/0734282913504808
35.
WatkinsM. W.BeaujeanA. A. (2013). Bifactor structure of the Wechsler Preschool and Primary Scale of Intelligence–Fourth Edition. School Psychology Quarterly, 29, 52-63. doi:10.1037/spq0000038
36.
WoodcockR. W.McGrewK. S.MatherN. (2001a). Woodcock–Johnson III. Itasca, IL: Riverside.
37.
WoodcockR. W.McGrewK. S.MatherN. (2001b). Woodcock–Johnson III Tests of Achievement. Itasca, IL: Riverside.
38.
WoodcockR. W.McGrewK. S.MatherN. (2001c). Woodcock–Johnson III Tests of Cognitive Abilities. Itasca, IL: Riverside.
