Previous research has demonstrated an audio-visual integration effect in supraliminal music-induced emotions. This study explores the effect of visual information on subliminal music-induced emotion and the audio-visual integration effect in subliminal music using combined behavioral and physiological measures. We introduced supraliminal and subliminal visual information to investigate their influence on subliminal music-induced emotion. The results indicate that, compared with audio-only presentation, audio-visual congruent presentation leads to a more intense emotional response, as evidenced by reduced heart rates and skin temperature. The differences in audio-visual congruence were more pronounced for positive music than for negative music, as indicated by reduced heart rates and skin temperature, along with increased alpha and beta power in the prefrontal cortex. In summary, the results suggest that audio-visual integration for subliminal music occurs with both supraliminal and subliminal visual information. Furthermore, positive subliminal music strengthens the perception of congruence between visual and auditory cues.
AarabiS.MohammadkhaniG.FarahaniS.JalaieS.ParandA.YaliK. P. (2023). Effect of subliminal auditory stimulation on components of auditory late responses and functional magnetic resonance imaging data in adults with normal hearing. Auditory and Vestibular Research, 32(3), 186–197.
2.
AlsiusA.MunhallK. G. (2013). Detection of audiovisual speech correspondences without visual awareness. Psychological Science, 24(4), 423–431.
3.
ArmonyJ. L.DolanR. J. (2002). Modulation of spatial attention by fear-conditioned stimuli: An event-related fMRI study. Neuropsychologia, 40(7), 817–826.
4.
BachD. R.Schmidt-DaffyM.DolanR. J. (2014). Facial expression influences face identity recognition during the attentional blink. Emotion, 14(6), 1007–1013.
5.
BaranZ.CANGÖZB.SalmanF. (2016). Does emotional context affect subliminal and supraliminal priming?Turkish Journal of Psychiatry, 27(1), 1–8.
6.
ChapadosC.LevitinD. J. (2008). Cross-modal interactions in the experience of musical performances: Physiological correlates. Cognition, 108(3), 639–651.
7.
ChenX.HanL.PanZ.LuoY.WangP. (2016). Influence of attention on bimodal integration during emotional change decoding: ERP evidence. International Journal of Psychophysiology, 106, 14–20.
8.
ChingA. S. M.KimJ.DavisC. (2019). Auditory–visual integration during nonconscious perception. Cortex, 117, 1–15.
9.
DahlénA. D.SchofieldA.SchiöthH. B.BrooksS. J. (2022). Subliminal emotional faces elicit predominantly right-lateralized amygdala activation: A systematic meta-analysis of fMRI studies. Frontiers in Neuroscience, 16, Article 868366.
10.
EthoferT.BretscherJ.WiethoffS.BischJ.SchlipfS.WildgruberD.KreifeltsB. (2013). Functional responses and structural connections of cortical areas for processing faces and voices in the superior temporal sulcus. NeuroImage, 76(8), 45–56.
11.
EysenckM. W.DerakshanN.SantosR.CalvoM. G. (2007). Anxiety and cognitive performance: Attentional control theory. Emotion, 7(2), 336–353.
12.
FaivreN.MudrikL.SchwartzN.KochC. (2014). Multisensory integration in complete unawareness: Evidence from audiovisual congruency priming. Psychological Science, 25(11), 2006–2016.
13.
FoxE.LesterV.RussoR.BowlesR. J.PichlerA.DuttonK. (2000). Facial expressions of emotion: Are angry faces detected more efficiently?Cognition & Emotion, 14(1), 61–92.
14.
FrumentoS.GemignaniA.MenicucciD. (2022). Perceptually visible but emotionally subliminal stimuli to improve exposure therapies. Brain Sciences, 12(7), 867.
15.
FrumentoS.PreatoniG.CheeL.GemignaniA.CiottiF.MenicucciD.RaspopovicS. (2024). Unconscious multisensory integration: Behavioral and neural evidence from subliminal stimuli. Frontiers in Psychology, 15, Article 1396946.
16.
GibbonsH. (2009). Evaluative priming from subliminal emotional words: Insights from event-related potentials and individual differences related to anxiety. Consciousness and Cognition, 18(2), 383–400.
17.
HuangY. X.LuoY. J. (2004). Native assessment of international affective picture system. Chinese Mental Health Journal, 19(9), 631–634.
18.
IonescuM. R. (2016). Subliminal perception of complex visual stimuli. Romanian Journal of Ophthalmology, 60(4), 226–230.
19.
JeongJ.DiwadkarV. A.ChuganiC. D.SinsoongsudP.MuzikO.BehenM. E.. . .ChuganiD. C. (2011). Congruence of happy and sad emotion in music and faces modifies cortical audiovisual activation. NeuroImage, 54(4), 2973–2982.
20.
KihlstromJ. F.MulvaneyS.TobiasB. A.TobisI. P. (2000). The emotional unconscious. In EichE.KihlstromJ. F.BowerG. H.ForgasJ. P.NiedenthalP. M. (Eds.), Cognition and emotion (pp. 30–86). Oxford University Press.
21.
KouiderS.DehaeneS. (2007). Levels of processing during non-conscious perception: A critical review of visual masking. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 362(1481), 857–875.
22.
LangP. J.BradleyM. M.CuthbertB. N. (1997). International affective picture system (IAPS): Technical manual and affective ratings. NIMH Center for the Study of Emotion and Attention.
LiddellB. J.WilliamsL. M.RathjenJ.ShevrinH.GordonE. (2004). A temporal dissociation of subliminal versus supraliminal fear perception: An event-related potential study. Journal of Cognitive Neuroscience, 16(3), 479–486.
25.
LinC.YehM.ShamsL. (2022). Subliminal audio-visual temporal congruency in music videos enhances perceptual pleasure. Neuroscience Letters, 779, 136623.
26.
LiuJ.WangY.SongH. M.BaiS.LiuQ. F.YangL.PengF. (2014). Effect of subliminal auditory stimulus on emotion. China Journal of Health Psychology, 22(5), 773–775.
27.
MitchellH. F.MacDonaldR. A. (2014). Listeners as spectators? Audio-visual integration improves music performer identification. Psychology of Music, 42(1), 112–127.
28.
PalmerT. D.RamseyA. K. (2012). The function of consciousness in multisensory integration. Cognition, 125(3), 353–364.
29.
PanF.ZhangL.OuY.ZhangX. (2019). The audio-visual integration effect on music emotion: Behavioral and physiological evidence. PLOS ONE, 14(5), Article e0217040.
30.
ParkJ. Y.GuB. M.KangD. H.ShinY. W.ChoiC. H.LeeJ. M.KwonJ. S. (2010). Integration of cross-modal emotional information in the human brain: An fMRI study. Cortex, 46(2), 161–169.
31.
PilarczykJ.KunieckiM. (2014). Emotional content of an image attracts attention more than visually salient features in various signal-to-noise ratio conditions. Journal of Vision, 14(12), 1–19.
32.
PlatzF.KopiezR. (2012). When the eye listens: A meta-analysis of how audio-visual presentation enhances the appreciation of music performance. Music Perception, 30(1), 71–83.
33.
PoolE.BroschT.DelplanqueS.SanderD. (2016). Attentional bias for positive emotional stimuli: A meta-analytic investigation. Psychological Bulletin, 142(1), 79–106.
34.
PottratzS. T.HutchinsonJ. C.KarageorghisC. I.MullinE. M.ZenkoZ. (2021). Prime movers: Effects of subliminal primes, music, and music video on psychological responses to exercise. Annals of Behavioral Medicine, 55(2), 112–122.
35.
PourtoisG.de GelderB.BolA.CrommelinckM. (2005). Perception of facial expressions and voices and of their combination in the human brain. Cortex, 41(1), 49–59.
36.
SchreinerM. W.DillahuntA. K.FrandsenS. B.DelDonnoS. R.SchubertB. L.PociusS. L.. . .LangeneckerS. A. (2022). Increased sensitivity of insula to supraliminal faces in adults with histories of mood disorders and self-injury. Journal of Psychiatric Research, 152, 167–174.
37.
ScottR. B.SamahaJ.ChrisleyR.DienesZ. (2018). Prevailing theories of consciousness are challenged by novel cross-modal associations acquired between subliminal stimuli. Cognition, 175, 169–185.
38.
TamiettoM.De GelderB. (2010). Neural bases of the non-conscious perception of emotional signals. Nature Reviews Neuroscience, 11(10), 697–709.
39.
TanJ. S.YehS. L. (2015). Audiovisual integration facilitates unconscious visual scene processing. Journal of Experimental Psychology: Human Perception and Performance, 41(5), 1325–1335.
40.
ThompsonW. F.RussoF. A.QuintoL. (2008). Audio-visual integration of emotional cues in song. Cognition and Emotion, 22(8), 1457–1470.
41.
VroomenJ.DriverJ.De GelderB. (2001). Is cross-modal integration of emotional expressions independent of attentional resources?Cognitive, Affective, & Behavioral Neuroscience, 1(4), 382–387.
42.
WeijkampJ.SadakataM. (2017). Attention to affective audio-visual information: Comparison between musicians and non-musicians. Psychology of Music, 45(2), 204–215.
43.
WiensS. (2006). Current concerns in visual masking. Emotion, 6(4), 675–680.
44.
WiensS. (2008). Concepts of visual consciousness and their measurement. Advances in Cognitive Psychology, 3(1–2), 349–359.
45.
WiensS.ÖhmanA. (2007). Probing unconscious emotional processes: On becoming a successful musketeer. In CoanJ. A.AllenJ. J. B. (Eds.), The handbook of emotion elicitation and assessment (pp. 65–90). Oxford University Press.
46.
ZhouX.WuY.ZhengY.XiaoZ.ZhengM. (2022). The mechanism and neural substrate of musical emotions in the audio-visual modality. Psychology of Music, 50(3), 779–796.
