One popular observational instrument to evaluate teaching is the Classroom Assessment Scoring System–Secondary (CLASS-S). Yet, the secondary version of the CLASS poorly discriminates classroom management quality beyond identifying extremely chaotic classrooms with teachers’ scores clustering in the most positive ranges of effectiveness. Studies of adolescents’ perceptions of teachers’ classroom management practices, however, clearly suggest more nuance and complexity. Assuming this discrepancy between results (i.e., lack of differentiation vs. nuanced complexity) might be an artifact of this particular observational protocol rather than a reflection of reality, this study microanalyzed the source material influencing adolescent and adult evaluative assessments of classroom management, using transcripts generated from video viewing sessions. Comparisons between (a) adolescents’ indigenous interpretations, and (b) adults’ trained interpretations of CLASS-S classroom management instructional interactions suggest that adolescents view student engagement and positive climate as particularly relevant to assessments of classroom management, whereas the CLASS-S does not include these as dimensions of effective teaching assessed as part of the Classroom Organization domain.
AllenJ. P.GregoryA.MikamiA.LunJ.HamreB.PiantaR. (2013). Observations of effective teacher-student interactions in secondary school classrooms: Predicting student achievement with the Classroom Assessment Scoring System–Secondary. School Psychology Review, 42, 76-98.
2.
AllenJ. P.PiantaR. C.GregoryA.MikamiA. Y.LunJ. (2011). An interaction-based approach to enhancing secondary school instruction and student achievement. Science, 333, 1034-1037.
3.
AloeA. M.AmoL. C.ShanahanM. E. (2014). Classroom management self-efficacy and burnout: A multivariate meta-analysis. Educational Psychology Review, 26, 101-126.
4.
BellC. A.GitomerD. H.McCaffreyD. F.HamreB. K.PiantaR. C.QiY. (2012). An argument approach to observation protocol validity. Educational Assessment, 17(2-3), 62-87.
5.
BellC. A.QiY.CroftA. J.LeusnerD.McCaffreyD. F.GitomerD. H.PiantaR. C. (2014). Improving observational score quality: Challenges in observer thinking. In KaneT.KerrK.PiantaR. (Eds.), Designing teacher evaluation systems (pp. 50-97). New York, NY: John Wiley.
6.
CasabiancaJ. M.LockwoodJ. R.McCaffreyD. M. (2015). Trends in classroom observation scores. Educational and Psychological Measurement, 75, 311-337.
7.
CasabiancaJ. M.McCaffreyD. F.GitomerD. H.BellC. A.HamreB. K.PiantaR. C. (2013). Effect of observation mode on measures of secondary mathematics teaching. Educational and Psychological Measurement, 73, 757-783.
8.
ChiuY.ChenK.HsuY.WangJ. (2018). Understanding the perceived quality of professors’ teaching effectiveness in various disciplines: The moderating effects of teaching at top colleges. Assessment & Evaluation in Higher Education, 44, 449-462.
9.
Cochran-SmithM.VillegasA. M. (2015). Framing teacher preparation research: An overview of the field, Part 1. Journal of Teacher Education, 66, 7-20.
10.
CooperK. S.MinessA. (2014). The co-creation of caring student-teacher relationships: Does teacher understanding matter?The High School Journal, 97, 264-290.
11.
CorrentiR.MatsumuraL. C.HamiltonL.WangE. (2013). Assessing students’ skills at writing analytically in response to texts. The Elementary School Journal, 114, 142-17.
12.
CothranD. J.KulinnaP. H.GarrahyD. A. (2003). “This is kind of giving a secret away . . .”: Students’ perspectives on effective class management. Teaching and Teacher Education, 19, 435-444.
EgenbergH.McConneyA. (2018). What do students believe about effective classroom management? A mixed-methods investigation in Western Australian high schools. The Australian Educational Researcher, 45, 195-216.
15.
EricksonF. (1986). Qualitative methods of inquiry. In WittrockM.C. (Ed.), Handbook of research on teaching (pp. 23-41). New York, NY: Macmillan.
16.
EvertsonC. M.WeinsteinC. S. (Eds.). (2006). Handbook of classroom management: Research, practice, and contemporary issues. Mahwah, NJ: Lawrence Erlbaum.
17.
FauthB.DecristanJ.RieserS.KliemeE.BüttnerG. (2014). Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes. Learning and Instruction, 29, 1-9.
18.
FergusonR. (2010, October14). Student perceptions of teaching effectiveness (Discussion Brief from the National Center for Teacher Effectiveness and the Achievement Gap Initiative). Cambridge, MA: Harvard University.
19.
GestS. D.MadillR. A.ZadzoraK. M.MillerA. M.RodkinP. C. (2014). Teacher management of elementary classroom social dynamics: Associations with changes in student adjustment. Journal of Emotional and Behavioral Disorders, 22, 107-118.
20.
GrayD. L.HopeE. C.MatthewsJ. S. (2018). Black and belonging at school: A case for interpersonal, instructional, and institutional opportunity structures. Educational Psychologist, 53, 97-113.).
21.
GreenbergJ.PutmanH.WalshK. (2014). Training our future teachers: Classroom management. Washington, DC: National Council on Teacher Quality.
22.
GregoryA.AllenJ. P.MikamiA. Y.HafenC. A.PiantaR. C. (2014). Effects of a professional development program on behavioral engagement of students in middle and high school. Psychology in the Schools, 51, 143-163.
23.
HafenC. A.HamreB. K.AllenJ. P.BellC. A.GitomerD. H.PiantaR. C. (2015). Teaching through interactions in secondary school classrooms: Revisiting the factor structure and practical application of the Classroom Assessment Scoring System–Secondary. Journal of Early Adolescence, 35, 651-680.
24.
KaneT. J.CantrellS. (2010). Learning about teaching: Initial findings from the measures of effective teaching project. Seattle, Washington: The Bill & Melinda Gates Foundation.
25.
KaneT. J.StaigerD. O. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Seattle, Washington: Bill & Melinda Gates Foundation.
26.
KennedyM. J.HirschS. E.RodgersW. J.BruceA.LloydJ. W. (2017). Supporting high school teachers’ implementation of evidence-based classroom management practices. Teaching and Teacher Education, 63, 47-57.
27.
KorpershoekH.HarmsT.de BoerH.van KuijkM.DoolaardS. (2016). A meta-analysis of the effects of classroom management strategies and classroom management programs on students’ academic, behavioral, emotional, and motivational outcomes. Review of Educational Research, 86, 643-680.
28.
KwokA. (2017). Relationships between instructional quality and classroom management for beginning urban teachers. Educational Researcher, 46, 355-365.
29.
La ParoK. M.PiantaR. C.StuhlmanM. (2004). The Classroom Assessment Scoring System: Findings from the prekindergarten year. The Elementary School Journal, 104, 409-426.
30.
LinsinM. (2013). The classroom management secret. San Diego, CA: JME.
31.
MarshH. W.RocheL. A. (1997). Making students’ evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist, 52, 1187-1197.
32.
McGarityJ. R.ButtsD. P. (1984). The relationship among teacher classroom management behavior, student engagement, and student achievement of middle and high school science students of varying aptitude. Journal of Research in Science Teaching, 21, 55-61.
33.
MikamiA. Y.GregoryA.AllenJ. P.PiantaR. C.LunJ. (2011). Effects of a teacher professional development intervention on peer relationships in secondary classrooms. School Psychology Review, 40, 367-385.
34.
MoralesE. E. (2017). Generating academic urgency through improved classroom management: A case study of a university and urban charter high school partnership. Educational Research Quarterly, 41, 25-42.
35.
NICHD Early Child Care Research Network. (1996). Characteristics of infant child care: Factors contributing to positive caregiving. Early Childhood Research Quarterly, 11, 269-306.
36.
NieY.LauS. (2009). Complementary roles of care and behavioral control in classroom management: The self-determination theory perspective. Contemporary Educational Psychology, 34, 185-194.
37.
PerlmanM.FalenchukO.FletcherB.McMullenE.BeyeneJ.ShahP. (2016). A systematic review and meta-analysis of a measure of staff/child interaction quality (the classroom assessment scoring system) in early childhood education and care settings and child outcomes. PLoS ONE, 11(12), 1-33.
38.
PiantaR. C.BelskyJ.VandergriftN.HoutsR.MorrisonF. J. (2008). Classroom effects on children’s achievement trajectories in elementary school. American Educational Research Journal, 45, 365-397.
39.
PiantaR. C.HamreB. K.MintzS. (2012). Classroom Assessment Scoring System–Secondary manual. Charlottesville: University of Virginia.
RaudenbushS. W.RowanB.KangS. J. (1991). A multilevel, multivariate model for studying school climate with estimation via the EM algorithm and application to U.S. high-school data. Journal of Educational and Behavioral Statistics, 16, 295-330.
42.
Rimm-KaufmanS. E.BaroodyA.LarsenR.CurbyT. W.AbryT. (2015). To what extent do teacher–student interaction quality and student gender contribute to fifth graders’ engagement in mathematics instruction?Journal of Educational Psychology, 107, 170-185.
43.
SchenkeK. (2015). Understanding mathematics classroom instruction through students and teachers (Doctoral dissertation). Available from eScholarship.org
44.
ShulmanL. (1986). The paradigms and research programs in the study of teaching. In WittrockM. C. (Ed.), Handbook of research on teaching (pp. 3-36). New York, NY: Macmillan.
45.
SmithT.PrestonC.HaynesK.BookerL. N. (2015). Understanding differences in instructional quality between high and lower value-added schools in a larger urban district. Teachers College Record, 117, 1-38.
46.
TaylorE. S.TylerJ. H. (2011). The effect of evaluation on performance: Evidence from longitudinal student achievement data of mid-career teachers (No. w16877). National Bureau of Economic Research.
47.
VirtanenT. E.LerkkanenM.-K.PoikkeusA.-M.KuorelahtiM. (2015). The relationship between classroom quality and students’ engagement in secondary school. Educational Psychology, 35, 963-983.
48.
WagnerW.GöllnerR.HelmkeA.TrautweinU.LüdtkeO. (2013). Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments. Learning and Instruction, 28, 1-11.
49.
WallaceT. L.KelceyB.RuzekE. (2016). What can student perception surveys tell us about teaching?: Empirically testing the underlying structure of the Tripod student perception survey. American Educational Research Journal, 53, 1834-1868.
50.
WallaceT. L.SungH. C. (2017). Student perceptions of autonomy-supportive instructional interactions in the middle grades. Journal of Experimental Education, 85, 425-449.
51.
WhiteM.RowanB. (2014). User guide to the Measures of Effective Teaching Longitudinal Database (MET LDB). Ann Arbor: Inter-University Consortium for Political and Social Research, University of Michigan.
52.
WileyC. (2019). Standardised module evaluation surveys in U.K. higher education: Establishing students’ perspectives. Studies in Educational Evaluation, 61, 55-65.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
