This study evaluated the Problem Behavior Frequency Scale–Adolescent Report (PBFS-AR), a measure designed to assess adolescents’ frequency of victimization, aggression, substance use, and delinquent behavior. Participants were 1,263 students (50% female; 78% African American, 18% Latino) from three urban middle schools in the United States. Confirmatory factor analyses of competing models of the structure of the PBFS-AR supported a model that differentiated among three forms of aggression (in-person physical, in-person relational, and cyber), two forms of victimization (in-person and cyber), substance use, and delinquent behavior. This seven-factor model fit the data well and demonstrated strong measurement invariance across groups that differed on sex and grade. Support was found for concurrent validity of the PBFS-AR based on its pattern of relations with school office discipline referrals.
BettencourtA. F.FarrellA. D. (2013). Individual and contextual factors associated with patterns of aggression and peer victimization during middle school. Journal of Youth and Adolescence, 42, 285-302. doi:10.1007/s10964-012-9854-8
3.
BradshawC. P.WaasdorpT. E.JohnsonS. L. (2015). Overlapping verbal, relational, physical, and electronic forms of bullying in adolescence: Influence of school context. Journal of Clinical Child & Adolescent Psychology, 44, 494-508. doi:10.1080/15374416.2014.893516
4.
BrownB. B. (2004). Adolescents’ relationships with peers. In LernerR.SteinbergL. (Eds.), Handbook of adolescent psychology (pp. 363-394). Hoboken, NJ: John Wiley. doi:10.1002/9780471726746.ch12
5.
CardN. A.StuckyB. D.SawalaniG. M.LittleT. D. (2008). Direct and indirect aggression during childhood and adolescence: A meta-analytic review of gender differences, intercorrelations, and relations to maladjustment. Child Development, 79, 1185-1229. doi:10.1111/j.1467-8624.2008.01184.x
6.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. doi:10.1207/S15328007SEM0902_5
7.
CohenJ. (1992). A power primer. Psychological Bulletin, 112, 155-159. doi:10.1037/0033-2909.112.1.155
8.
CrickN. R.GrotpeterJ. K. (1995). Relational aggression, gender, and social-psychological adjustment. Child Development, 66, 710-22. doi:10.2307/1131945
9.
DahlbergL.ToalS.SwahnM.BehrensC. (2005). Measuring violence-related attitudes, behaviors, and influences among youths: A compendium of assessment tools (2nd ed.). Atlanta, GA: Centers for Disease Control and Prevention, National Center for Injury Prevention and Control.
10.
De Los ReyesA.KazdinA. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483-509. doi:10.1037/0033-2909.131.4.483
11.
De Los ReyesA.PrinsteinM. J. (2004). Applying depression-distortion hypotheses to the assessment of peer victimization in adolescents. Journal of Clinical Child & Adolescent Psychology, 33, 325-335. doi:10.1207/s15374424jccp3302_14
12.
FarrellA. D.GoncyE. A.SullivanT. N.ThompsonE. (2017). Victimization, aggression, and other problem behaviors: Trajectories of change within and across middle school grades. Journal Research on Adolescence, 28, 438-455. doi:10.1111/jora.12346
13.
FarrellA. D.KungE. M.WhiteK. S.ValoisR. (2000). The structure of self-reported aggression, drug use, and delinquent behaviors during early adolescence. Journal of Clinical Child Psychology, 29, 282-292. doi:10.1207/S15374424jccp2902_13
14.
FarrellA. D.SullivanT. N.GoncyE. A.LeA. H. (2016). Assessment of adolescents’ victimization, aggression, and problem behaviors: Evaluation of the Problem Behavior Frequency Scale. Psychological Assessment, 28, 702-714. doi:10.1037/pas0000225
15.
FarrellA. D.SullivanT. N.SutherlandK. S.CoronaR.MashoS. (2018). Evaluation of the Olweus Bully Prevention Program in an urban school system in the USA. Prevention Science, 19, 833-847. doi:10.1007/s11121-018-0923-4
16.
FurlongM. J.SharkeyJ. D.FelixE. D.TanigawaD.GreenJ. G. (2010). Bullying assessment: A call for increased precision of self-reporting procedures. In SimersonJ. R.SwearerS. M.EspelageD. L. (Eds.), Handbook of bullying in schools: An international perspective (pp. 329-346). New York, NY: Routledge.
17.
GalenB. R.UnderwoodM. K. (1997). A developmental investigation of social aggression among children. Developmental Psychology, 33, 589-600. doi:10.1037/0012-1649.33.4.589
18.
GrahamJ. W.TaylorB. J.CumsilleP. E. (2001). Planned missing data designs in the analysis of change. In CollinsL. M.SayerA. G. (Eds.), New methods for the analysis of change (pp. 335-353). Washington, DC: American Psychological Association. doi:10.1037/10409-011
19.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
20.
HuntC.PetersL.RapeeR. M. (2012). Development of a measure of the experience of being bullied in youth. Psychological Assessment, 24, 156-165. doi:10.1037/a0025178
21.
JessorR. (2014). Problem behavior theory: A half-century of research on adolescent behavior and development. In LernerR. M.PetersenA. C.SilbereisenR. K.Brooks-GunnJ. (Eds.), The developmental science of adolescence: History through autobiography (pp. 239-256). New York, NY: Psychology Press.
22.
KolbeL. J.KannL.CollinsJ. L. (1993). Overview of the youth risk behavior surveillance system. Public Health Reports, 108, 2-10.
23.
KowalskiR. M.GiumettiG. W.SchroederA. N.LattannerM. R. (2014). Bullying in the digital age: A critical review and meta-analysis of cyberbullying research among youth. Psychological Bulletin, 140, 1073-1137. doi:10.1037/a0035618
24.
LandollR. R.La GrecaA. M.LaiB. S.ChanS. F.HergeW. M. (2015). Cyber victimization by peers: Prospective associations with adolescent social anxiety and depressive symptoms. Journal of Adolescence, 42, 77-86. doi:10.1016/j.adolescence.2015.04.002
25.
LittleT. D.JonesS. M.HenrichC. C.HawleyP. H. (2003). Disentangling the “whys” from the “whats” of aggressive behavior. International Journal of Behavioral Development, 27, 122-133. doi: 10.1177/0165025408089273
26.
MarseeM. A.BarryC. T.ChildsK. K.FrickP. J.KimonisE. R.MuñozL. C.. . . LauK. S. L. (2011). Assessing the forms and functions of aggression using self-report: Factor structure and invariance of the Peer Conflict Scale in youths. Psychological Assessment, 23, 792-804. doi:10.1037/a0023369
27.
MarshH. W.NagengastB.MorinA. J. S.ParadaR. H.CravenR. G.HamiltonL. R. (2011). Construct validity of the multidimensional structure of bullying and victimization: An application of exploratory structural equation modeling. Journal of Educational Psychology, 103, 701-732. doi:10.1037/a0024122
28.
McIntoshK.FisherE. S.KennedyK. S.CraftC. B.MorrisonG. M. (2012). Using office discipline referrals and school exclusion data to assess school discipline. In JimersonS. R.NickersonA. B.MayerM. J.FurlongM. J. (Eds.), Handbook of school violence and school safety (pp. 305-315). New York, NY: Routledge.
29.
McLaughlinK. A.HatzenbuehlerM. L.HiltL. M. (2009). Emotion dysregulation as a mechanism linking peer victimization to internalizing symptoms in adolescents. Journal of Consulting and Clinical Psychology, 77, 894-904. doi:10.1037/a0015760
30.
MehariK. R.FarrellA. D. (2018). Where does cyberbullying fit? A comparison of competing models of adolescent aggression. Psychology of Violence, 8, 31-42. doi:10.1037/vio0000081
31.
MehariK. R.FarrellA. D.LeA. (2014). Cyberbullying: Measures in search of a construct. Psychology of Violence, 4, 399-415. doi:10.1037/a0037521
32.
MenesiniE. (2012). Cyberbullying: The right value of the phenomenon: Comments on the paper “Cyberbullying: An overrated phenomenon?” European Journal of Developmental Psychology, 9, 544-552. doi:10.1080/17405629.2012.706449
33.
MishnaF.SainiM.SolomonS. (2009). Ongoing and online: Children and youth’s perceptions of cyber bullying. Children and Youth Services Review, 32, 1222-1228. doi:10.1016/j.childyouth.2009.05.004
34.
MuthénB.SatorraA. (1995). Complex sample data in structural equation modeling. In MarsdenP. V. (Ed.), Sociological methodology (pp. 267-316). Washington, DC: American Sociological Association. doi:10.2307/271070
35.
NylundK.BellmoreA.NishinaA.GrahamS. (2007). Subtypes, severity, and structural stability of peer victimization: What does latent class analysis say?Child Development, 78, 1706-1722. doi:10.1111/j.1467-8624.2007.01097.x
36.
OlweusD.LimberS. P. (2010). Bullying in school: Evaluation and dissemination of the Olweus Bullying Prevention Program. American Journal of Orthopsychiatry, 80, 124-134. doi:10.1111/j.1939-0025.2010.01015.x
37.
PrinsteinM. J.BoergersJ.VernbergE. M. (2001). Overt and relational aggression in adolescents: Social-psychological adjustment of aggressors and victims. Journal of Clinical Child Psychology, 30, 479-491. doi:10.1207/S15374424JCCP3004_05
38.
QueirósA. N.VagosP. (2016). Measures of aggression and victimization in Portuguese adolescents: Cross-cultural validation of the Revised Peer Experience Questionnaire. Psychological Assessment, 28, e141-e151. doi:10.1037/pas0000363
39.
ReynoldsC. R.KamphausR. W. (2004). Behavioral assessment system for children, second edition. Minneapolis, MN: Pearson Assessments.
40.
RosenL. H.BeronK. J.UnderwoodM. K. (2013). Assessing peer victimization across adolescence: Measurement invariance and developmental change. Psychological Assessment, 25, 1-11. doi:10.1037/a0028985
41.
SalmivalliC.SainioM.HodgesE. V. E. (2013). Electronic victimization: Correlates, antecedents, and consequences among elementary and middle school students. Journal of Clinical Child & Adolescent Psychology, 42, 442-453. doi:10.1080/15374416.2012.759228
42.
SkibaR. J.HornerR. H.ChungC.RauschM. K.MayS. L.TobinT. (2011). Race is not neutral: A national investigation of African American and Latino disproportionality in school discipline. School Psychology Review, 40, 85-107.
43.
SmithP. K. (2012). Cyberbullying: Challenges and opportunities for a research program: A response to Olweus (2012). European Journal of Developmental Psychology, 9, 553-558. doi:10.1080/17405629.2012.689821
44.
TokunagaR. S. (2010). Following you home from school: A critical review and synthesis of research on cyberbullying victimization. Computers in Human Behavior, 26, 277-287. doi:10.1016/j.chb.2009.11.014
45.
VoulgaridouI.KokkinosC. M. (2015). Relational aggression in adolescents: A review of theoretical and empirical research. Aggression and Violent Behavior, 23, 87-97. doi:10.1016/j.avb.2015.05.006
46.
WaasdorpT. E.PasE. T.ZablotskyB.BradshawC. P. (2017). Ten-year trends in bullying and related attitudes among 4th- to 12th-graders. Pediatrics, 139, e20162615. doi:10.1542/peds.2016-2615
47.
WangJ.IannottiR. J.NanselT. R. (2009). School bullying among adolescents in the United States: Physical, verbal, relational, and cyber. Journal of Adolescent Health, 45, 368-375. doi:10.1016/j.jadohealth.2009.03.021
48.
WidamanK. F.ReiseS. P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In BryantK. J.WindleM. (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281-324). Washington, DC: American Psychological Association. doi:10.1037/10222-009
49.
YoungstromE.LoeberR.Stouthamer-LoeberM. (2000). Patterns and correlates of agreement between parent, teacher, and male adolescent ratings of externalizing and internalizing problems. Journal of Consulting and Clinical Psychology, 68, 1038-1050. doi:10.1037/0022-006X.68.6.1038
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
