Sage Journals: Discover world-class research

Abstract

This article points to the long-standing and significant role that the sound interface plays in shaping the ways we attend to media by considering its phatic function. Employing a reverse engineering approach, the article consists of an analysis of historical transformations in the regimen of attention produced by sound media to date, followed by discourse analyses of scientific and industry communities of digital sound interface design. Introducing the term “phatic alignment” to describe how media and humans are arranged in space and adjusted to communicate with one another, this article points to the increasing hold of the digital sound interface over the user’s attention and identifies the premises affording this trend. The article argues that in abstracting the human ear as an automated “phatic threshold” that regulates the user’s attention, digital sound interface design situates the user in constant attentiveness to media and sets the stage for next-generation communication technologies.

Keywords

Attention interface interface design phatic communication sound voice assistants

Get full access to this article

View all access options for this article.

References

Akrich

(1992) The de-scription of technical objects. In: Bijker

Law

(eds) Shaping Technology, Building Society: Studies in Sociotechnical Change. Cambridge, MA: MIT Press, pp. 205–224.

Alper

(2017) Giving Voice: Mobile Communication, Disability, and Inequality. Cambridge, MA: MIT Press.

Apple CEO Tim Cook at D10 Full 100 Minute Video (2012) Available at: https://www.youtube.com/watch?v=eUAPHgiEniQ (accessed 6 September 2019).

Apple Developer (2017) Designing sound—WWDC 2017—videos—Apple Developer. Available at: https://developer.apple.com/videos/play/wwdc2017/803/ (accessed 6 September 2019).

Aronson

(1971) The sociology of the telephone. International Journal of Comparative Sociology 12(3): 153–167.

Barthes

(1985) The Responsibility of Forms: Critical Chapters on Music, Art, and Representation. New York: Hill and Wang.

Bijsterveld

Cleophas

Krebs

, et al. (2014) Sound and Safe: A History of Listening behind the Wheel. Oxford and New York: Oxford University Press.

Bishop

Phillips

(2002) Manufacturing emergencies. Theory, Culture & Society 19(4): 91–102.

Boettinger

(1977) Our sixth-and-a-half sense. In: De Sola Pool

(ed.) The Social Impact of the Telephone. Cambridge, MA: MIT Press, pp. 200–207.

10.

Brewster

(2007) Non-speech auditory output. In: Jacko

Sears

(eds) Human-Computer Interaction Handbook. Boca Raton, FL: CRC Press, pp. 220–239.

11.

Caldwell

(1995) Televisuality: Style, Crisis, and Authority in American Television. New Brunswick, NJ: Rutgers University Press.

12.

Cheng

(2014) Sound Play: Video Games and the Musical Imagination. New York: Oxford University Press.

13.

Cherry

(1977) The telephone system: creator of mobility and social change. In: De Sola Pool

(ed.) The Social Impact of the Telephone. Cambridge, MA: MIT Press, pp. 112–126.

14.

Chion

(1994) Audio-Vision: Sound on Screen. New York: Columbia University Press.

15.

Chun

WHK

(2005) On software, or the persistence of visual knowledge. Grey Room 18: 26–51.

16.

Collins

(2008) Game Sound: An Introduction to the History, Theory, and Practice of Video Game Music and Sound Design. Cambridge, MA: MIT Press.

17.

Collins

(2013) Playing with Sound: A Theory of Interacting with Sound and Music in Video Games. Cambridge, MA: MIT Press.

18.

Corbin

(1998) Village Bells: Sound and Meaning in the 19th-Century French Countryside. New York: Columbia University Press.

19.

Crary

(1992) Techniques of the Observer: On Vision and Modernity in the Nineteenth Century. Cambridge, MA: MIT Press.

20.

Crary

(2001) Suspensions of Perception: Attention, Spectacle, and Modern Culture. Cambridge, MA: MIT Press.

21.

Daughtry

(2015) Listening to War: Sound, Music, Trauma, and Survival in Wartime Iraq. New York: Oxford University Press.

22.

Douglas

(1999) Listening in: Radio and the American Imagination. Minneapolis, MN: University of Minnesota Press.

23.

Drucker

(2011) Humanities approaches to interface theory. Culture Machine 12: 1–20.

24.

Ellis

(1982) Visible Fictions: Cinema, Television, Video. London: Routledge.

25.

Fairclough

(1995) Critical Discourse Analysis: The Critical Study of Language. London: Longman.

26.

Farman

(2018) Delayed Response: The Art of Waiting from the Ancient to the Instant World. New Haven, CT: Yale University Press.

27.

Franinović

Serafin

(2013) Introduction. In: Franinović

Serafin

(eds) Sonic Interaction Design. Cambridge, MA: MIT Press, pp. vii–xiv.

28.

Friedberg

(1993) Window Shopping: Cinema and the Postmodern. Berkeley, CA: University of California Press.

29.

Frosh

(2018a) The mouse, the screen and the Holocaust witness: interface aesthetics and moral response. New Media & Society 20(1): 351–368.

30.

Frosh

(2018b) The Poetics of Digital Media. Cambridge: Polity Press.

31.

Galloway

(2012) The Interface Effect. Cambridge: Polity Press.

32.

Garfield

(1983) The tyranny of the horn—automobile, that is. Essays of an Information Scientist 6(11): 216–222.

33.

Gaver

(1989) The SonicFinder: an interface that uses auditory icons. Human–Computer Interaction 4(1): 67–94.

34.

Gilbert

(2019) Amazon’s annual letter to shareholders from Jeff Bezos: 2018. Business Insider, 11 April. Available at: https://www.businessinsider.com/amazon-ceo-jeff-bezos-2018-letter-to-shareholders-2019-4?utm_source=hearst&utm_medium=referral&utm_content=allverticals (accessed 6 September 2019).

35.

Google Design (2019) Sound design and sonic brand (Google I/O’19). Available at: https://www.youtube.com/watch?v=r6Nzqcotujc&feature=youtu.be (accessed 6 September 2019).

36.

Google Event October 4 2017 Rick Osterloh Introduction to NewAI Vision (2017) Available at: https://www.youtube.com/watch?v=Y-vWQFjfMv8 (accessed 6 September 2019).

37.

Gumbrecht

(2004) Production of Presence: What Meaning Cannot Convey. Stanford, CA: Stanford University Press.

38.

Harwell

(2018) The accent gap: how Amazon’s and Google’s smart speakers leave certain voices behind. Washington Post, 19 July. Available at: https://www.washingtonpost.com/graphics/2018/business/alexa-does-not-understand-your-accent/ (accessed 11 May 2020).

39.

Hassoun

(2015) “All over the place”: a case study of classroom multitasking and attentional performance. New Media & Society 17(10): 1680–1695.

40.

Herbert

(2012) Modes of music listening and modes of subjectivity in everyday life. Journal of Sonic Studies 2(1). Available at: https://www.researchcatalogue.net/view/225321/225322 (accessed 16 October 2019).

41.

International Community for Auditory Display (n.d.-a) About ICAD. Available at: https://icad.org/about/ (accessed 9 July 2019).

42.

International Community for Auditory Display (n.d.-b) ICAD conferences. Available at: https://icad.org/conferences/ (accessed 19 May 2020).

43.

Jakobson

(1960) Closing statement: linguistics and poetics. In: Sebeok

(ed.) Style in Language. Cambridge, MA: MIT Press, pp. 350–377.

44.

Jeff Bezos vs. Peter Thiel and Donald Trump —Jeff Bezos CEO Amazon —Code Conference 2016 (2016). Available at: https://www.youtube.com/watch?v=guVxubbQQKE&t=412s (accessed 6 September 2019).

45.

Kassabian

(2013) Ubiquitous Listening: Affect, Attention, and Distributed Subjectivity. Berkeley, CA: University of California Press.

46.

Klingman

(1995) Israeli children’s responses to the stress of the Gulf War: a year later. School Psychology International 16(3): 303–313.

47.

Krajewski

(2018) The Server: A Media History from the Present to the Baroque. New Haven, CT: Yale University Press.

48.

Kramer

(1994) Introduction. In: Kramer

(ed.) Auditory Display: Sonification, Audification, and Auditory Interfaces. Reading, MA: Perseus, pp. 1–77.

49.

Krebs

Van Drie

(2014) The art of stethoscope use: diagnostic listening practices of medical physicians and “auto doctors.” ICON: Journal of the International Committee for the History of Technology 20(2): 92–114.

50.

Lacey

(2013) Listening Publics: The Politics and Experience of Listening in the Media Age. Cambridge: Polity Press.

51.

Liu

(2018) ‘Hey, I didn’t order this dollhouse!’ 6 hilarious Alexa mishaps. Digital Trends. Available at: https://www.digitaltrends.com/home/funny-accidental-amazon-alexa-ordering-stories/ (accessed 6 September 2019).

52.

Lynskey

(2019) ‘Alexa, are you invading my privacy?’—the dark side of our voice assistants. The Guardian, 9 October. Available at: https://www.theguardian.com/technology/2019/oct/09/alexa-are-you-invading-my-privacy-the-dark-side-of-our-voice-assistants (accessed 20 October 2019).

53.

McCullough

(2013) Ambient Commons: Attention in the Age of Embodied Information. Cambridge, MA: MIT Press.

54.

McLuhan

(1964) Understanding Media: The Extensions of Man. New York: McGraw-Hill.

55.

McLuhan

(1988) Laws of Media: The New Science. Toronto, ON, Canada: University of Toronto Press.

56.

Manovich

(2001) The Language of New Media. Cambridge, MA: MIT Press.

57.

Mayer

(1977) The telephone and the uses of time. In: De Sola Pool

(ed.) The Social Impact of the Telephone. Cambridge, MA: MIT Press, pp. 225–245.

58.

Method Podcast from Google Design (2018) Conor O’Sullivan of Google Pixel. Available at: http://googledesignmethod.libsyn.com/conor-osullivan-of-google-pixel (accessed 6 September 2019).

59.

Miller

(2017) Playable Bodies: Dance Games and Intimate Media. New York: Oxford University Press.

60.

Mills

(2015) Deafness. In: Novak

Sakakeeny

(eds) Keywords in Sound. Durham, NC: Duke University Press, pp. 45–54.

61.

Nees

Walker

(2009) Auditory interfaces and sonification. In: Stephanidis

(ed.) The Universal Access Handbook. Boca Raton, FL: CRC Press, pp. 507–521.

62.

Panopoulos

(2018) “Bells.” In: The International Encyclopedia of Anthropology. John Wiley & Sons. Available at: https://onlinelibrary.wiley.com/doi/abs/10.1002/9781118924396.wbiea1634 (accessed 22 August 2019).

63.

Parisi

(2018) Archaeologies of Touch: Interfacing with Haptics from Electricity to Computing. Minneapolis, MN: University of Minnesota Press.

64.

Parks

(2004) Kinetic screens: epistemologies of movement at the interface. In: Couldry

McCarthy

(eds) Mediaspace: Place, Scale and Culture in a Media Age. London: Routledge, pp. 37–57.

65.

Peres

Best

Brock

, et al. (2008) Auditory interfaces. In: Kortum

(ed.) HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces. San Francisco, CA: Morgan Kaufmann, pp. 147–195.

66.

Peters

(1999) Speaking into the Air: A History of the Idea of Communication. Chicago, IL: University of Chicago Press.

67.

Pijanowski

Villanueva-Rivera

Dumyahn

, et al. (2011) Soundscape ecology: the science of sound in the landscape. BioScience 61(3): 203–216.

68.

Plotnick

(2013) Signal and Switch: A Cultural History of the Push-button Interface. PhD dissertation. Northwestern University. Available at: https://search.proquest.com/openview/dbc0150144c2f54404bce691a91cd66d/1?pq-origsite=gscholar&cbl=18750&diss=y (accessed 20 April 2020).

69.

Plotnick

(2017) Force, flatness and touch without feeling: thinking historically about haptics and buttons. New Media & Society 19(10): 1632–1652.

70.

Plotnick

(2018) Power Button: A History of Pleasure, Panic, and the Politics of Pushing. Cambridge, MA: MIT Press.

71.

Pullin

(2009) Design Meets Disability. Cambridge, MA: MIT Press.

72.

Rehding

(2014) Of sirens old and new. In: Gopinath

Stanyek

(eds) The Oxford Handbook of Mobile Music Studies. Oxford: Oxford University Press, pp. 77–106.

73.

Rice

(2012) Sounding bodies: medical students and the acquisition of stethoscopic perspectives. In: Pinch

Bijsterveld

(eds) The Oxford Handbook of Sound Studies. New York: Oxford University Press, pp. 298–319.

74.

Rice

(2015) Listening. In: Novak

Sakakeeny

(eds) Keywords in Sound. Durham, NC: Duke University Press, pp. 99–111.

75.

Robertson

(2015) Sound decision: inside the world of audio branding with Skype’s new pings, bounces, and pops. The Verge, 7 October. Available at: https://www.theverge.com/2015/10/7/9455159/skype-sound-design-computer-audio-branding-longform (accessed 6 September 2019).

76.

Ronell

(1989) The Telephone Book: Technology, Schizophrenia, Electric Speech. Lincoln, NE: University of Nebraska Press.

77.

Schaeffer

(2017) Treatise on Musical Objects: An Essay across Disciplines. Berkeley, CA: University of California Press.

78.

Schafer

(1993) The Soundscape: Our Sonic Environment and the Tuning of the World. Rochester, VT: Destiny Books.

79.

Schwartz

(2003) The indefensible ear: a history. In: Bull

Back

(eds) The Auditory Culture Reader. Oxford: Berg, pp. 487–501.

80.

Serafin

(2014) Sonic interactions in multimodal environments: an overview. In: Collins

Kapralos

Tessler

(eds) The Oxford Handbook of Interactive Audio. Oxford: Oxford University Press, pp. 234–246.

81.

Shannon

Weaver

(1949) The Mathematical Theory of Communication. Urbana, IL: The University of Illinois Press.

82.

Smith

(2003) Listening to the heard worlds of antebellum America. In: Bull

Back

(eds) The Auditory Culture Reader. Oxford: Berg, pp. 137–163.

83.

Sterne

(2003) The Audible past: Cultural Origins of Sound Reproduction. Durham, NC: Duke University Press.

84.

Sterne

(2012) MP3: The Meaning of a Format. Durham, NC: Duke University Press.

85.

Stone

(2009) Continuous partial attention. Available at: https://lindastone.net/qa/continuous-partial-attention/ (accessed 13 August 2019).

86.

Supper

(2012) The search for the “killer application”: drawing the boundaries around the sonification of scientific data. In: Bijsterveld

Pinch

(eds) The Oxford Handbook of Sound Studies. Oxford: Oxford University Press, pp. 249–270.

87.

Taylor

Introcaso

(2017) The bleeps, the sweeps, and the creeps! Twenty thousand hertz 30. Available at: https://www.20k.org/episodes/the-bleeps-the-sweeps-and-the-creeps (accessed 6 September 2019).

88.

Titon

(2015) Thoreau’s ear. Sound Studies 1(1): 144–154.

89.

Truax

(2001) Acoustic Communication. Westport, CT: Ablex Publishing.

90.

Udacity (2017) Keynote: Conversational AI in Amazon Alexa - Ashwin Ram, Udacity Intersect 2017. Available at: https://www.youtube.com/watch?v=j-ioUmQUmD8 (accessed 13 July 2020).

91.

Verhoeff

Cooley

(2014) The navigational gesture: traces and tracings at the mobile touchscreen interface. NECSUS European Journal of Media Studies 3(1): 111–128.

92.

Walker

Nees

(2011) Theory of sonification. In: Hermann

Hunt

Neuhoff

(eds) The Sonification Handbook. Berlin: Logos Publishing House, pp. 9–39.

93.

Williams

(2014) The Bells of Russia: History and Technology. Princeton, NJ: Princeton University Press.

94.

Wodak

Meyer

(2009) Methods for Critical Discourse Analysis. London: SAGE.

95.

Wood

(2007) Digital Encounters. London: Routledge.

96.

Wurtzel

Turner

(1977) Latent functions of the telephone: what missing the extension means. In: De Sola Pool

(ed.) The Social Impact of the Telephone. Cambridge, MA: MIT Press, pp. 246–261.