Restricted accessResearch articleFirst published online 2023-6
Ecological and Convergent Validity of Experimentally and Dynamically Assessed Capacity for Social Contingency Detection Using the Perceptual Crossing Experiment in Adolescence
The Perceptual Crossing Experiment (PCE) captures the capacity for social contingency detection using real-time social interaction dynamics but has not been externally validated. We tested ecological and convergent validity of the PCE in a sample of 208 adolescents from the general population, aged 11 to 19 years. We expected associations between PCE performance and (a) quantity and quality of social interaction in daily life, using Experience Sampling Methodology (ESM; ecological validity) and (b) self-reported social skills using a questionnaire (convergent validity). We also expected PCE performance to better explain variance in ESM social measures than self-reported social skills. Multilevel analyses showed that only self-reported social skills were positively associated with social experience of company in daily life. These initial results do not support ecological and convergent validity of the PCE. However, fueled by novel insights regarding the complexity of capturing social dynamics, we identified promising methodological advances for future validation efforts.
AchterhofR.KirtleyO. J.SchneiderM.HagemannN.HermansK. S. F. M.HiekkarantaA. P.LeceiA.DecosterJ.DeromC.De HertM.GuloksuzS.JacobsN.Menne-LothmannC.RuttenB.ThieryE.van OsJ.van WinkelR.WichersM.Myin-GermeysI. (2020, August11). General psychopathology and its social correlates in the daily lives of youth. PsyArXiv. Advance online publication.
2.
AchterhofR.KirtleyO. J.SchneiderM.HagemannN.HermansK. S. F. M.HiekkarantaA. P.LeceiA.LafitG.Myin-GermeysI. (2022). Adolescents’ real-time social and affective experiences of online and face-to-face interactions. Computers in Human Behavior, 129, Article 107159. https://doi.org/10.1016/j.chb.2021.107159
3.
AchterhofR.KirtleyO. J.SchneiderM.LafitG.HagemannN.HermansK. S. F. M.HiekkarantaA. P.LeceiA.Myin-GermeysI. (2021). Daily-life social experiences as a potential mediator of the relationship between parenting and psychopathology in adolescence. Frontiers in Psychiatry, 12, Article 697127. https://doi.org/10.3389/fpsyt.2021.697127
4.
AchterhofR.Myin-GermeysI.BampsE.HagemannN.HermansK. S. F. M.HiekkarantaA. P.JanssensJ.LeceiA.LafitG.KirtleyO. (2021, June14). COVID-19-related changes in adolescents’ daily-life social interactions and psychopathology symptoms. PsyArXiv. Advance update publication. https://doi.org/10.31234/osf.io/5nfp2
5.
AchterhofR.SchneiderM.KirtleyO. J.WampersM.DecosterJ.DeromC.Myin-GermeysI. (2020, March23). Be (com)ing social: Daily-life social interactions and parental bonding. PsyArXiv. Advance online publication. https://doi.org/10.31234/osf.io/xwkdq
6.
AndersonS. F.KelleyK.MaxwellS. E. (2017). Sample-size planning for more accurate statistical power: A method adjusting sample effect sizes for publication bias and uncertainty. Psychological Science, 28(11), 1547–1562. https://doi.org/10.1177/0956797617723724
BenningS. D.BachrachR. L.SmithE. A.FreemanA. J.WrightA. G. C. (2019). The registration continuum in clinical science: A guide toward transparent practices. Journal of Abnormal Psychology, 128(6), 528–540. https://doi.org/10.1037/abn0000451
10.
BirchwoodM.SmithJ.CochraneR.WettonS.CopestakeS. (1990). The social functioning scale the development and validation of a new scale of social adjustment for use in family intervention programmes with schizophrenic patients. British Journal of Psychiatry, 157(6), 853–859. https://doi.org/10.1192/bjp.157.6.853
BottiniS. (2018). Social reward processing in individuals with autism spectrum disorder: A systematic review of the social motivation hypothesis. Research in Autism Spectrum Disorders, 45, 9–26. https://doi.org/10.1016/j.rasd.2017.10.001
13.
CandadaiM.SetzlerM.IzquierdoE. J.FroeseT. (2019). Embodied dyadic interaction increases complexity of neural dynamics: A minimal agent-based simulation model. Frontiers in Psychology, 10, 540. https://doi.org/10.3389/fpsyg.2019.00540
14.
ConstantinoJ. N.PrzybeckT.FriesenD.ToddR. D. (2000). Reciprocal social behavior in children with and without pervasive developmental disorders. Journal of Developmental & Behavioral Pediatrics, 21(1), 2–11.
15.
CronbachL. J.MeehlP. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
16.
CsikszentmihalyiM.LarsonR. (2014). Validity and reliability of the experience-sampling method. In: Flow and the foundations of positive psychology (pp. 35–54). Springer, Dordrecht.. https://doi.org/10.1007/978-94-017-9088-8_3
17.
DahlR. E.AllenN. B.WilbrechtL.SuleimanA. B. (2018). Importance of investing in adolescence from a developmental science perspective. Nature, 554(7693), 441–450. https://doi.org/10.1038/nature25770
18.
De JaegherH.Di PaoloE.GallagherS. (2010). Can social interaction constitute social cognition?Trends in Cognitive Sciences, 14(10), 441–447. https://doi.org/10.1016/j.tics.2010.06.009
19.
Del PretteZ. A. P.PretteA. D.De OliveiraL. A.GreshamF. M.VanceM. J. (2012). Role of social performance in predicting learning problems: Prediction of risk using logistic regression analysis. School Psychology International, 33(6), 615–630. https://doi.org/10.1177/0020715211430373
20.
FlakeJ. K.PekJ.HehmanE. (2017). Construct validation in social and personality research. Social Psychological and Personality Science, 8(4), 370–378. https://doi.org/10.1177/1948550617693063
21.
FriedE. I.RobinaughD. J. (2020). Systems all the way down: Embracing complexity in mental health research. BMC Medicine, 18(1), Article 205. https://doi.org/10.1186/s12916-020-01668-w
22.
FroeseT.GallagherS. (2012). Getting interaction theory (IT) together: Integrating developmental, phenomenological, enactive, and dynamical approaches to social interaction. Interaction Studies, 13(3), 436–468. https://doi.org/10.1075/is.13.3.06fro
23.
FroeseT.IizukaH.IkegamiT. (2013). From synthetic modeling of social interaction to dynamic theories of brain–body–environment–body–brain systems. Behavioral and Brain Sciences, 36(4), 420–421. https://doi.org/10.1017/s0140525x12001902
24.
FroeseT.IizukaH.IkegamiT. (2014). Embodied social interaction constitutes social cognition in pairs of humans: A minimalist virtual reality experiment. Science Reports, 4(1), Article 3672. https://doi.org/10.1038/srep03672
25.
FroeseT.Zapata-FonsecaL.LeenenI.FossionR. (2020). The feeling is mutual: Clarity of haptics-mediated social perception is not associated with the recognition of the other, only with recognition of each other. Frontiers in Human Neuroscience, 14, 560567. https://doi.org/10.3389/fnhum.2020.560567
26.
FrostK. H.StraussG. P. (2016). A review of anticipatory pleasure in schizophrenia. Current Behavioral Neuroscience Reports, 3, 232–247. https://doi.org/10.1007/s40473-016-0082-5
27.
GreshamF. M. (2016). Social skills assessment and intervention for children and youth. Cambridge Journal of Education, 46(3), 319–332. https://doi.org/10.1080/0305764x.2016.1195788
28.
HermansK. S. F. M.KasanovaZ.Zapata-FonsecaL.LafitG.FossionR.FroeseT.Myin-GermeysI. (2020). Investigating real-time social interaction in pairs of adolescents with the Perceptual Crossing Experiment. Behavior Research Methods, 52(5), 1929–1938. https://doi.org/10.3758/s13428-020-01378-4
29.
HermansK. S. F. M.KirtleyO. J.KasanovaZ.AchterhofR.HagemannN.HiekkarantaA. P.LeceiA.Zapata-FonsecaL.LafitG.FossionR.FroeseT.Myin-GermeysI. (2021). Capacity for social contingency detection continues to develop across adolescence. Social Development, 1–19. https://doi.org/10.1111/sode.12567
30.
HesselsR. S. (2020). How does gaze to faces support face-to-face interaction? A review and perspective. Psychonomic Bulletin & Review, 27, 856–881. https://doi.org/10.3758/s13423-020-01715-w
31.
HoxJ. J.MoerbeekM.Van de SchootR. (2010). Multilevel analysis: Techniques and applications. Routledge.
32.
JacobsonN. C. (2020). Compliance thresholds in intensive longitudinal data: Worse than listwise deletion: Call for action [Symposium]. Society for Ambulatory Assessment, Melbourne, Australia.
33.
KesslerR. C. (2007). Psychiatric epidemiology: Challenges and opportunities. International Review of Psychiatry, 19(5), 509–521. https://doi.org/10.1080/09540260701564914
34.
KirtleyO. J.AchterhofR.HagemannN.HermansK. S. F. M.HiekkarantaA. P.LeceiA.BoetsB.HenquetC.KasanovaZ.SchneiderM.Van WinkelR.ReininghausU.ViechtbauerW.Myin-GermeysI. (2021, April2). Initial cohort characteristics and protocol for SIGMA: An accelerated longitudinal study of environmental factors, inter- and intrapersonal processes, and mental health in adolescence. PsyArXiv. Advance online publication. https://doi.org/10.31234/osf.io/jp2fk
LafitG.AdolfJ. K.DejonckheereE.Myin-GermeysI.ViechtbauerW.CeulemansE. (2021). Selection of the number of participants in intensive longitudinal studies: A user-friendly Shiny app and tutorial to perform power analysis in multilevel regression models that account for temporal dependencies. Advances in Methods and Practices in Psychological Science, 4(1), Article 2515245920978738. https://doi.org/10.1177/2515245920978738
37.
LaurenceauJ.-P.BolgerN. (2012). Analyzing diary and intensive longitudinal data from dyads. In MehlM.ConnerT. (Eds.), Handbook of research methods for studying daily life (pp. 407–422). Guilford.
38.
LeeK. T. H.LewisR. W.KataokaS.SchenkeK.VandellD. L. (2018). Out-of-school time and behaviors during adolescence. Journal of Research on Adolescence, 28(2), 284–293. https://doi.org/10.1111/jora.12389
LeongV.SchilbachL. (2019). The promise of two-person neuroscience for developmental psychiatry: Using interaction-based sociometrics to identify disorders of social interaction. British Journal of Psychiatry, 215(5), 636–638. https://doi.org/10.1192/bjp.2019.73
41.
LittleS. G.SwanglerJ.Akin-LittleA. (2017). Defining social skills. In MatsonJ. (Ed.), Handbook of social behavior and skills in children (pp. 9–17). Springer. https://doi.org/10.1007/978-3-319-64592-6_2
42.
MeersK.DejonckheereE.KalokerinosE. K.RummensK.KuppensP. (2020). MobileQ: A free user-friendly application for collecting experience sampling data. Behavior Research Methods, 52, 1510–1515. https://doi.org/10.3758/s13428-019-01330-1
43.
MoteJ.FulfordD. (2020). Ecological momentary assessment of everyday social experiences of people with schizophrenia: A systematic review. Schizophrenia Research, 216, 56–68. https://doi.org/10.1016/j.schres.2019.10.021
Myin-GermeysI.KasanovaZ.VaessenT.VachonH.KirtleyO.ViechtbauerW.ReininghausU. (2018). Experience sampling methodology in mental health research: New insights and technical developments. World Psychiatry, 17(2), 123–132.
46.
NewenA.De BruinL.GallagherS. (Eds.). (2018). The Oxford handbook of 4E cognition. Oxford University Press.
47.
Osborne-CrowleyK. (2020). Social cognition in the real world: Reconnecting the study of social cognition with social reality. Review of General Psychology, 24(2), 144–158. https://doi.org/10.1177/1089268020906483
48.
Palmier-ClausJ. E.Myin-GermeysI.BarkusE.BentleyL.UdachinaA.DelespaulP. A. E. G.LewisS. W.DunnG. (2011). Experience sampling research in individuals with mental illness: Reflections and guidance. Acta Psychiatrica Scandinavica, 123(1), 12–20. https://doi.org/10.1111/j.1600-0447.2010.01596.x
49.
PanX.HamiltonA. F. C. (2018). Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape. British Journal of Psychology, 109(3), 395–417. https://doi.org/10.1111/bjop.12290
PouwelsJ. L.ValkenburgP. M.BeyensI.van DrielI. I.KeijsersL. (2021). Social media use and friendship closeness in adolescents’ daily lives: An experience sampling study. Developmental Psychology, 57(2), 309–323.
SchilbachL. (2016). Towards a second-person neuropsychiatry. Philosophical Transactions of the Royal Society B: Biological Sciences, 371(1686), 20150081. https://doi.org/10.1098/rstb.2015.0081
54.
SchneiderM.ReininghausU.Van NieropM.JanssensM.Myin-GermeysI. (2017). Does the Social Functioning Scale reflect real-life social functioning? An experience sampling study in patients with a non-affective psychotic disorder and healthy control individuals. Psychological Medicine, 47(16), 2777–2786. https://doi.org/10.1017/s0033291717001295
55.
StataCorp. (2015). Stata statistical software: Release 14. StataCorp LP.
TrevarthenC.AitkenK. J. (2001). Infant intersubjectivity: Research, theory, and clinical applications. Journal of Child Psychology and Psychiatry, 42(1), 3–48. https://doi.org/10.1111/1469-7610.00701
59.
Van der PloegJ. D.ScholteE. M. (2013). Vragenlijst Psycho-sociale Vaardigheden. Bohn Stafleu van Loghum.
60.
VanhalstJ.GoossensL.LuyckxK.ScholteR. H. J.EngelsR. C. M. E. (2013). The development of loneliness from mid- to late adolescence: Trajectory classes, personality traits, and psychosocial functioning. Journal of Adolescence, 36(6), 1305–1312. https://doi.org/10.1016/j.adolescence.2012.04.002
61.
van RoekelE.KeijsersL.ChungJ. M. (2019). A review of current ambulatory assessment studies in adolescent samples and practical recommendations. Journal of Adolescent Research, 29(3), 560–577. https://doi.org/10.1111/jora.12471
62.
WangJ. M.RubinK. H.LaursenB.Booth-LaforceC.Rose-KrasnorL. (2013). Preference-for-solitude and adjustment difficulties in early and late adolescence. Journal of Clinical Child & Adolescent Psychology, 42(6), 834–842. https://doi.org/10.1080/15374416.2013.794700
63.
ZampellaC. J.CsumittaK. D.SimonE.BennettoL. (2020). Interactional synchrony and its association with social and communication ability in children with and without autism spectrum disorder. Journal of Autism and Developmental Disorders, 50, 3195–3206. https://doi.org/10.1007/s10803-020-04412-8
64.
Zapata-FonsecaL.DotovD.FossionR.FroeseT. (2016). Time-series analysis of embodied interaction: Movement variability and complexity matching as dyadic properties. Frontiers in Psychology, 7, 1940. https://doi.org/10.3389/fpsyg.2016.01940
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
