Measures of school-level growth in student outcomes are common tools for assessing the impacts of schools. The vast majority of these measures use standardized tests as the outcome of interest, even though emerging evidence demonstrates the importance of social–emotional learning (SEL). In this article, we present results from using the first large-scale panel surveys of students on SEL to produce school-level value-added measures by grade for growth mind-set, self-efficacy, self-management, and social awareness. We found substantive differences across schools in SEL growth, with magnitudes of differences similar to those for growth in academic achievement. In contrast, we found that the goodness of fit of the value-added model was considerably lower when the outcome variables were measures of SEL constructs rather than of academic achievement. In addition, the across-school variance in the average level of the SEL measures was proportionally much smaller than that for academic measures. These findings recommend caution in interpreting measures as the causal impacts of schools on SEL, though they also do not rule out important school effects.
AllensworthE. M.EastonJ. Q. (2007). What matters for staying on-track and graduating in Chicago public high schools: A close look at course grades, failures, and attendance in the freshman year. Chicago, IL: Consortium on Chicago School Research.
2.
AngristJ.HullP.PathakP.WaltersC. (2016). Interpreting tests of school VAM validity. American Economic Review: Papers and Proceedings, 106, 388–392.
3.
AngristJ.HullP.PathakP.WaltersC. (2017). Leveraging lotteries for school value-added: Testing and estimation. Quarterly Journal of Economics, 132, 871–919.
4.
BanduraA. (1997). Self-efficacy: The exercise of control. New York, NY: W. H. Freeman.
5.
BattistichV.SchapsE.WilsonN. (2004). Effects of an elementary school intervention on students’ “connectedness” to school and social adjustment during middle school. Journal of Primary Prevention, 24, 243–262.
6.
BerkowitzR.MooreH.AstorR. A.BenbenishtyR. (2016). A research synthesis of the associations between socioeconomic background, inequality, school climate, and academic achievement. Review of Educational Research, 87, 425–469.
7.
BlackwellL. S.TrzesniewskiK. H.DweckC. S. (2007). Implicit theories of intelligence predict achievement across an adolescent transition: A longitudinal study and an intervention. Child Development, 78, 246–263.
8.
BlazarD. (2018). Validating teacher effects on students’ attitudes and behaviors: Evidence from random assignment of teachers to students. Education Finance and Policy, 13, 281–309.
9.
BlazarD.KraftM. A. (2017). Teacher and teaching effects on students’ attitudes and behaviors. Educational Evaluation and Policy Analysis, 39, 146–170.
10.
BlumR. W.LibbeyH. P.BishopJ. H.BishopM. (2004). School connectedness—Strengthening health and education outcomes for teenagers. Journal of School Health, 74, 231–235.
11.
BriggsD.WeeksJ. (2011). The persistence of school-level value-added. Journal of Educational and Behavioral Statistics, 36, 616–637.
12.
ChamberlainG. E. (2013). Predictive effects of teachers and schools on test scores, college attendance, and earnings. Proceedings of the National Academy of Sciences of the United States of America, 110, 17176–17182.
13.
ChettyR.FriedmanJ. N.RockoffJ. E. (2014). Measuring the impacts of teachers II: Teacher value-added and student outcomes in adulthood. American Economic Review, 104, 2633–2679.
14.
ChiangH.LipscombS.GillB. (2016). Is school value added indicative of principal quality?Education Finance and Policy, 11, 283–309.
15.
CohenG. L.GarciaJ.ApfelN.MasterA. (2006). Reducing the racial achievement gap: A social-psychological intervention. Science, 313, 1307–1310.
16.
Collaborative for Academic, Social, and Emotional Learning. (2005). Safe and sound: An educational leader’s guide to evidence-based social and emotional learning programs (Illinois ed.). Chicago, IL: Author.
17.
DavidsonL.CrowderM.GordonR.DomitrovichC.BrownR.HayesB. (2018). A continuous improvement approach to social and emotional competency measurement. Journal of Applied Developmental Psychology, 55, 93–106.
18.
DemingD. (2014). Using school choice lotteries to test measures of school effectiveness. American Economic Review: Papers and Proceedings, 104, 406–411.
19.
DurlakJ.WeissbergR.DymnickiA.TaylorR.SchellingerK. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432.
20.
DweckC. (2006). Mindset: The new psychology of success. New York, NY: Random House.
21.
Education Analytics. (2017). Growth Model for Educator Evaluation 2016/17 (Technical report, prepared for the New York State Education Department by Education Analytics). Madison, WI.
22.
EhlertM.KoedelC.ParsonsE.PodgurskyM. (2016). Selecting growth measures for use in school evaluation systems: Should proportionality matter?Educational Policy, 30, 465–500.
23.
FullerW. (1987). Measurement error models. Hoboken, NJ: John Wiley.
24.
GawadeN.MeyerR. (2016). Measuring teacher effectiveness using value-added models of high school achievement. Teachers College Record, 118, 1–32.
GershensonS. (2016). Linking teacher quality, student attendance, and student achievement. Education Finance and Policy, 11, 125–149.
27.
GrissomJ.KalogridesD.LoebS. (2015). Using student test scores to measure principal performance. Educational Evaluation and Policy Analysis, 37, 3–28.
28.
GuarinoC.ReckaseM.WooldridgeJ. (2015). Can value-added measures of teacher performance be trusted?Education Finance and Policy, 10, 117–156.
29.
HallingerP. (2005). Instructional leadership and the school principal: A passing fancy that refuses to fade away. Leadership and Policy in Schools, 4, 221–239.
30.
HamreB. K.PiantaR. C. (2006). Student–teacher relationships. In BearG. G.MinkeK. M. (Eds.), Children’s needs III: Development, prevention, and intervention (pp. 59–71). Washington, DC: National Association of School Psychologists.
31.
HeckmanJ. J.RubinsteinY. (2001). The importance of noncognitive skills: Lessons from the GED testing program. American Economic Review, 91, 145–149.
32.
JacksonK. (2018). What do test scores miss? The importance of teacher effects on non-test-score outcomes. Journal of Political Economy, 126, 2072–2107.
33.
JenningsJ. L.DiPreteT. A. (2010). Teacher effects on social and behavioral skills in early elementary school. Sociology of Education, 83, 135–159.
34.
JenningsP. A.GreenbergM. T. (2009). The prosocial classroom: Teacher social and emotional competence in relation to student and classroom outcomes. Review of Educational Research, 79, 491–525.
35.
KaneT.StaigerD. (2001). Improving school accountability measures(National Bureau of Economic Research, working paper 8156). Cambridge, MA: National Bureau of Economic Research.
36.
KaneT.StaigerD. (2002). Volatility in school test scores: Implications for test-based accountability systems. In RavitchD. (Ed.), Brookings papers on education policy (pp. 235–283). Washington, DC: Brookings Institution.
37.
KautzT.HeckmanJ.DirisR.ter WeelB.BorghansL. (2014). Fostering and measuring skills: Improving cognitive and non-cognitive skills to promote lifetime success. Paris, France: Organization for Economic Co-Operation and Development.
38.
KoedelC.BettsJ. (2010). Value added to what? How a ceiling in the testing instrument influences value-added estimation. Education Finance and Policy, 5, 54–81.
39.
LaddH. F.SorensenL. C. (2017). Returns to teacher experience: Student achievement and motivation in middle school. Education Finance and Policy, 12, 241–279.
40.
LaddH. F.WalshR. (2002). Implementing value-added measures of school effectiveness: Getting the incentives right. Economics of Education Review, 21, 1–17.
41.
LeithwoodK.LouisK. S.AndersonS.WahlstromK. (2004). Review of research: How leadership influences student learning. St. Paul, MN: Center for Applied Research and Educational Improvement.
42.
LiuJ.LoebS. (2018). Engaging teachers: Measuring the impact of teachers on student attendance in secondary school(CEPA working paper No. 17-01). Retrieved fromhttp://cepa.stanford.edu/wp17-01
43.
MastersG. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174.
44.
McCaffreyD.LockwoodJ. R.KoretzD.LouisT.HamiltonL. (2004). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics, 29, 67–101.
45.
McCormickM. P.CappellaE.O’ConnorE. E.McClowryS. G. (2015). Context matters for social emotional learning: Examining variation in program impact by dimensions of school climate. American Journal of Community Psychology, 56, 101–119.
46.
MeyerR. (1997). Value-added indicators of school performance: A primer. Economics of Education Review, 16, 283–301.
47.
MeyerR.DokumaciE. (2015). Value-added models and the next generation of assessments. In LissitzR. W. (Ed.), Value added modeling and growth modeling with particular application to teacher and school effectiveness (pp. 139–190). Charlotte, NC: Information Age.
MurakiE. (1992). A generalized partial credit model: Application of an EM algorithm(ETS research report 92-06). Princeton, NJ: Educational Testing Service.
50.
OlweusD. (1994). Bullying at school. In HuesmannL. R. (Ed.), Aggressive behavior: Current perspectives (pp. 97–130). Boston, MA: Springer.
51.
RaudenbushS.WillmsD. (1995). The estimation of school effects. Journal of Educational and Behavioral Statistics, 20, 307–355.
52.
ReardonS.RaudenbushR. (2009). Assumptions of value-added models for estimating school effects. Education Finance and Policy, 4, 492–519.
53.
RivkinS. G.HanushekE. A.KainJ. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73, 417–458.
54.
RuzekE. A.DominaT.ConleyA. M.DuncanG. J.KarabenickS. A. (2015). Using value-added models to measure teacher effects on students’ motivation and achievement. The Journal of Early Adolescence, 35, 852–882.
TekweC.CarterR.MaC. X.AlginaJ.LucasM.RothJ.,…ResnickM. (2004). An empirical comparison of statistical models for value-added assessment of school performance. Journal of Educational and Behavioral Statistics, 29, 11–36.
TtofiM. M.FarringtonD. P. (2011). Effectiveness of school-based programs to reduce bullying: A systematic and meta-analytic review. Journal of Experimental Criminology, 7, 27–56.
60.
WatersT.MarzanoR. J.McNultyB. (2003). Balanced leadership: What 30 years of research tells us about the effect of leadership on student achievement. Aurora, CO: Mid-Continent Research for Education and Learning.
61.
WestM. R.BuckleyK.KrachmanS. B.BookmanN. (2018). Development and implementation of student social-emotional surveys in the CORE districts. Journal of Applied Developmental Psychology, 55, 119–129.
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
