Sound design

Sound design is the art and practice of creating soundtracks for a variety of needs. It involves specifying, acquiring or creating auditory elements using audio production techniques and tools. It is employed in a variety of disciplines including filmmaking, television production, video game development, theatre, sound recording and reproduction, live performance, sound art, post-production, radio, new media and musical instrument development. Sound design commonly involves performing (see e.g. foley) and editing of previously composed or recorded audio, such as sound effects and dialogue for the purposes of the medium, but it can also involve creating sounds from scratch through synthesizers. A sound designer is one who practices sound design.

History

See also: Prehistoric music

The use of sound to evoke emotion, reflect mood and underscore actions in plays and dances began in prehistoric times. At its earliest, it was used in religious practices for healing or recreation. In ancient Japan, theatrical events called kagura were performed in Shinto shrines with music and dance.^[1]

 

A musician at a commedia dell'arte show (Karel Dujardins, 1657)

Plays were performed in medieval times in a form of theatre called Commedia dell'arte, which used music and sound effects to enhance performances. The use of music and sound in the Elizabethan Theatre followed, in which music and sound effects were produced off stage using devices such as bells, whistles, and horns. Cues would be written in the script for music and sound effects to be played at the appropriate time.^[2]

Italian composer Luigi Russolo built mechanical sound-making devices, called "intonarumori," for futurist theatrical and music performances starting around 1913. These devices were meant to simulate natural and man-made sounds, such as trains and bombs. Russolo's treatise, The Art of Noises, is one of the earliest written documents on the use of abstract noise in the theatre. After his death, his intonarumori' were used in more conventional theatre performances to create realistic sound effects.

Recorded sound

Possibly the first use of recorded sound in the theatre was a phonograph playing a baby's cry in a London theatre in 1890.^[3] Sixteen years later, Herbert Beerbohm Tree used recordings in his London production of Stephen Phillips’ tragedy NERO. The event is marked in the Theatre Magazine (1906) with two photographs; one showing a musician blowing a bugle into a large horn attached to a disc recorder, the other with an actor recording the agonizing shrieks and groans of the tortured martyrs. The article states: “these sounds are all realistically reproduced by the gramophone”. As cited by Bertolt Brecht, there was a play about Rasputin written in (1927) by Alexej Tolstoi and directed by Erwin Piscator that included a recording of Lenin's voice. Whilst the term "sound designer" was not in use at this time, a number of stage managers specialised as "effects men", creating and performing offstage sound effects using a mix of vocal mimicry, mechanical and electrical contraptions and gramophone records. A great deal of care and attention was paid to the construction and performance of these effects, both naturalistic and abstract.^[4] Over the course of the twentieth century the use of recorded sound effects began to take over from live sound effects, though often it was the stage manager's duty to find the sound effects and an electrician played the recordings during performances.

Between 1980 and 1988, Charlie Richmond, USITT's first Sound Design Commissioner, oversaw efforts of their Sound Design Commission to define the duties, responsibilities, standards and procedures which might normally be expected of a theatre sound designer in North America. This subject is still regularly discussed by that group, but during that time, substantial conclusions were drawn and he wrote a which, although now somewhat dated, provides a succinct record of what was expected at that time. It was subsequently provided to both the ADC and David Goodman at the Florida USA local when they were both planning to represent sound designers in the 1990s.

Digital technology

 

Modern digital control room at Tainted Blue Studios, 2010

MIDI and digital audio technology have contributed to the evolution of sound production techniques in the 1980s and 1990s. Digital audio workstations (DAW) and a variety of digital signal processing algorithms applied in them allow more complicated soundtracks with more tracks as well as auditory effects to be realized. Features such as unlimited undo and sample-level editing allows fine control over the soundtracks.

In theatre sound, features of computerized theatre sound design systems have also been recognized as being essential for live show control systems at Walt Disney World and, as a result, Disney utilized systems of that type to control many facilities at their Disney-MGM Studios theme park, which opened in 1989. These features were incorporated into the MIDI Show Control (MSC) specification, an open communications protocol used to interact with diverse devices. The first show to fully utilize the MSC specification was the Magic Kingdom Parade at Walt Disney World's Magic Kingdom in September, 1991.

The rise of interest in game audio has also brought more advanced interactive audio tools that are also accessible without a background in computer programming. Some of such software tools (termed "implementation tools" or "audio engines") feature a workflow that's similar to that in more conventional DAW programs and can also allow the sound production personnel to undertake some of the more creative interactive sound tasks (that are considered to be part of sound design for computer applications) that previously would have required a computer programmer. Interactive applications have also given rise to a plethora of techniques in "dynamic audio" which loosely means sound that's "parametrically" adjusted during the run-time of the program. This allows for a broader expression in sounds, more similar to that in films, because this way the sound designer can e.g. create footstep sounds that vary in a believable and non-repeating way and that also corresponds to what's seen in the picture. The digital audio workstation cannot directly "communicate" with game engines, because the game's events occur often in an unpredictable order, whereas traditional digital audio workstations as well as so called linear media (TV, film etc.) have everything occur in the same order every time the production is run. Especially games have also brought in dynamic or adaptive mixing.

The World Wide Web has greatly enhanced the ability of sound designers to acquire source material quickly, easily and cheaply. Nowadays, a designer can preview and download crisper, more "believable" sounds as opposed to toiling through time- and budget-draining "shot-in-the-dark" searches through record stores, libraries and "the grapevine" for (often) inferior recordings. In addition, software innovation has enabled sound designers to take more of a DIY (or "do-it-yourself") approach. From the comfort of their home and at any hour, they can simply use a computer, speakers and headphones rather than renting (or buying) costly equipment or studio space and time for editing and mixing. This provides for faster creation and negotiation with the director.

Applications

Film

See also: Sound editor (filmmaking), Foley artist, and Director of audiography

In motion picture production, a Sound Editor/Designer is a member of a film crew responsible for the entirety or some specific parts of a film's soundtrack.^[5] In the American film industry, the title Sound Designer is not controlled by any professional organization, unlike titles such as Director or Screenwriter.

The terms sound design and sound designer began to be used in the motion picture industry in 1969. At that time, The title of Sound Designer was first granted to Walter Murch by Francis Ford Coppola in recognition for Murch's contributions to the film The Rain People.^[6] The original meaning of the title Sound Designer, as established by Coppola and Murch, was "an individual ultimately responsible for all aspects of a film's audio track, from the dialogue and sound effects recording to the re-recording (mix) of the final track".^[7] The term sound designer has replaced monikers like supervising sound editor or re-recording mixer for what was essentially the same position: the head designer of the final sound track. Editors and mixers like Murray Spivack (King Kong), George Groves (The Jazz Singer), James G. Stewart (Citizen Kane), and Carl Faulkner (Journey to the Center of the Earth) served in this capacity during Hollywood's studio era, and are generally considered to be sound designers by a different name.

The advantage of calling oneself a sound designer beginning in later decades was two-fold. It strategically allowed for a single person to work as both an editor and mixer on a film without running into issues pertaining to the jurisdictions of editors and mixers, as outlined by their respective unions. Additionally, it was a rhetorical move that legitimised the field of post-production sound at a time when studios were downsizing their sound departments, and when producers were routinely skimping on budgets and salaries for sound editors and mixers. In so doing, it allowed those who called themselves sound designers to compete for contract work and to negotiate higher salaries. The position of Sound Designer therefore emerged in a manner similar to that of Production Designer, which was created in the 1930s when William Cameron Menzies made revolutionary contributions to the craft of art direction in the making of Gone with the Wind.^[8]

The audio production team is a principal member of the production staff, with creative output comparable to that of the film editor and director of photography. Several factors have led to the promotion of audio production to this level, when previously it was considered subordinate to other parts of film:

• Cinema sound systems became capable of high-fidelity reproduction, particularly after the adoption of Dolby Stereo. Before stereo soundtracks, film sound was of such low fidelity that only the dialogue and occasional sound effects were practical. These sound systems were originally devised as gimmicks to increase theater attendance, but their widespread implementation created a content vacuum that had to be filled by competent professionals. Dolby's immersive Dolby Atmos format, introduced in 2012, provides the sound team with 128 tracks of audio that can be assigned to a 7.1.2 bed that utilizes two overhead channels, leaving 118 tracks for audio objects that can be positioned around the theater independent of the sound bed. Object positions are informed by metadata that places them based on X, Y, Z coordinates and the number of speakers available in the room. This immersive sound format expands creative opportunities for the use of sound beyond what was achievable with older 5.1 and 7.1 surround sound systems. The greater dynamic range of the new systems, coupled with the ability to produce sounds at the sides, behind, or above the audience, provided the audio post-production team new opportunities for creative expression in film sound. ^[9]

• Some directors were interested in realizing the new potential of the medium. A new generation of filmmakers, the so-called "Easy Riders and Raging Bulls"—Martin Scorsese, Steven Spielberg, George Lucas, and others—were aware of the creative potential of sound and wanted to use it.
• Filmmakers were inspired by the popular music of the era. Concept albums of groups such as Pink Floyd and The Beatles suggested new modes of storytelling and creative techniques that could be adapted to motion pictures.
• New filmmakers made their early films outside the Hollywood establishment, away from the influence of film labor unions and the then rapidly dissipating studio system.

The contemporary title of sound designer can be compared with the more traditional title of supervising sound editor; many sound designers use both titles interchangeably.^[10] The role of supervising sound editor, or sound supervisor, developed in parallel with the role of sound designer. The demand for more sophisticated soundtracks was felt both inside and outside Hollywood, and the supervising sound editor became the head of the large sound department, with a staff of dozens of sound editors, that was required to realize a complete sound job with a fast turnaround.^[11][12]

Theatre

See also: Sound reinforcement system and Architectural acoustics

Sound design, as a distinct discipline, is one of the youngest fields in stagecraft, second only to the use of projection and other multimedia displays, although the ideas and techniques of sound design have been around almost since theatre started. Dan Dugan, working with three stereo tape decks routed to ten loudspeaker zones^[13] during the 1968–69 season of American Conservatory Theater (ACT) in San Francisco, was the first person to be called a sound designer.^[14]

A theatre sound designer is responsible for everything the audience hears in the performance space, including music, sound effects, sonic textures, and soundscapes. These elements are created by the sound designer, or sourced from other sound professionals, such as a composer in the case of music. Pre-recorded music must be licensed from a legal entity that represents the artist's work. This can be the artist themselves, a publisher, record label, performing rights organization or music licensing company.^[15] The theatre sound designer is also in charge of choosing and installing the sound system —speakers, sound desks, interfaces and convertors, playout/cueing software, microphones, radio mics, foldback, cables, computers, and outboard equipment like FX units and dynamics processors.^[16]

Modern audio technology has enabled theatre sound designers to produce flexible, complex, and inexpensive designs that can be easily integrated into live performance. The influence of film and television on playwriting is seeing plays being written increasingly with shorter scenes, which is difficult to achieve with scenery but easily conveyed with sound. The development of film sound design is giving writers and directors higher expectations and knowledge of sound design. Consequently, theatre sound design is widespread and accomplished sound designers commonly establish long-term collaborations with directors.

Musicals

Sound design for musicals often focuses on the design and implementation of a sound reinforcement system that will fulfil the needs of the production. If a sound system is already installed in the performance venue, it is the sound designer's job to tune the system for the best use for a particular production. Sound system tuning employs various methods including equalization, delay, volume, speaker and microphone placement, and in some cases, the addition of new equipment. In conjunction with the director and musical director, if any, the sound reinforcement designer determines the use and placement of microphones for actors and musicians. The sound reinforcement designer ensures that the performance can be heard and understood by everyone in the audience, regardless of the shape, size or acoustics of the venue, and that performers can hear everything needed to enable them to do their jobs. While sound design for a musical largely focuses on the artistic merits of sound reinforcement, many musicals, such as Into the Woods also require significant sound scores (see Sound Design for Plays). Sound Reinforcement Design was recognized by the American Theatre Wing's Tony Awards with the Tony Award for Best Sound Design of a Musical until the 2014-15 season,^[17] later reinstating in the 2017-18 season.^[18]

Plays

Sound design for plays often involves the selection of music and sounds (sound score) for a production based on intimate familiarity with the play, and the design, installation, calibration and utilization of the sound system that reproduces the sound score. The sound designer for a play and the production's director work together to decide the themes and emotions to be explored. Based on this, the sound designer for plays, in collaboration with the director and possibly the composer, decides upon the sounds that will be used to create the desired moods. In some productions, the sound designer might also be hired to compose music for the play. The sound designer and the director usually work together to "spot" the cues in the play (i.e., decide when and where sound will be used in the play). Some productions might use music only during scene changes, whilst others might use sound effects. Likewise, a scene might be underscored with music, sound effects or abstract sounds that exist somewhere between the two. Some sound designers are accomplished composers, writing and producing music for productions as well as designing sound. Many sound designs for plays also require significant sound reinforcement (see Sound Design for Musicals). Sound Design for plays was recognized by the American Theatre Wing's Tony Awards with the Tony Award for Best Sound Design of a Play until the 2014-15 season,^[17] later reinstating the award in the 2017-18 season.^[18]

Professional organizations

• Theatrical Sound Designers and Composers Association (TSDCA)
• The Association of Sound Designers is a trade association representing theatre sound designers in the UK.
• United Scenic Artists (USA) Local USA829, which is integrated within IATSE, represents theatrical sound designers in the United States.
• Theatrical Sound Designers in English Canada are represented by the Associated Designers of Canada (ADC), and in Québec by l'Association des professionnels des arts du Québec (APASQ).

Music

In the contemporary music business, especially in the production of rock music, ambient music, progressive rock, and similar genres, the record producer and recording engineer play important roles in the creation of the overall sound (or soundscape) of a recording, and less often, of a live performance. A record producer is responsible for extracting the best performance possible from the musicians and for making both musical and technical decisions about the instrumental timbres, arrangements, etc. On some, particularly more electronic music projects, artists and producers in more conventional genres have sometimes sourced additional help from artists often credited as "sound designers", to contribute specific auditory effects, ambiences etc. to the production. These people are usually more versed in e.g. electronic music composition and synthesizers than the other musicians on board.

In the application of electroacoustic techniques (e.g. binaural sound) and sound synthesis for contemporary music or film music, a sound designer (often also an electronic musician) sometimes refers to an artist who works alongside a composer to realize the more electronic aspects of a musical production. This is because sometimes there exists a difference in interests between composers and electronic musicians or sound designers. The latter specialises in electronic music techniques, such as sequencing and synthesizers, but the former is more experienced in writing music in a variety of genres. Since electronic music itself is quite broad in techniques and often separate from techniques applied in other genres, this kind of collaboration can be seen as natural and beneficial.

Notable examples of (recognized) sound design in music are the contributions of Michael Brook to the U2 album The Joshua Tree, George Massenburg to the Jennifer Warnes album Famous Blue Raincoat, Chris Thomas to the Pink Floyd album The Dark Side of the Moon, and Brian Eno to the Paul Simon album Surprise.

In 1974, Suzanne Ciani started her own production company, Ciani/Musica. Inc., which became the #1 sound design music house in New York.^[19]

Fashion

In fashion shows, the sound designer often works with the artistic director to create an atmosphere fitting the theme of a collection, commercial campaign or event.^{[citation needed]}

Computer applications and other applications

Sound is widely used in a variety of human–computer interfaces, in computer games and video games.^[20][21] There are a few extra requirements for sound production for computer applications, including reusability, interactivity and low memory and CPU usage. For example, most computational resources are usually devoted to graphics. Audio production should account for computational limits for sound playback with audio compression or voice allocating systems.

Sound design for video games requires proficient knowledge of audio recording and editing using a digital audio workstation, and an understanding of game audio integration using audio engine software, audio authoring tools, or middleware to integrate audio into the game engine. Audio middleware is a third-party toolset that sits between the game engine and the audio hardware. ^[22]

Interactivity with computer sound can involve using a variety of playback systems or logic, using tools that allow the production of interactive sound (e.g. Max/MSP, Wwise). Implementation might require software or electrical engineering of the systems that modify sound or process user input. In interactive applications, a sound designer often collaborates with an engineer (e.g. a sound programmer) who's concerned with designing the playback systems and their efficiency.

Awards

Sound designers have been recognized by awards organizations for some time, and new awards have emerged more recently in response to advances in sound design technology and quality. The Motion Picture Sound Editors and the Academy of Motion Picture Arts and Sciences recognizes the finest or most aesthetic sound design for a film with the Golden Reel Awards for Sound Editing in the film, broadcast, and game industries, and the Academy Award for Best Sound respectively. In 2021, the 93rd Academy Awards merged Best Sound Editing and Best Sound Mixing into one general Best Sound category. In 2007, the Tony Award for Best Sound Design was created to honor the best sound design in American theatre on Broadway.^[23]

North American theatrical award organizations that recognize sound designers include these:

• Dora Mavor Moore Awards
• Drama Desk Awards
• Helen Hayes Awards
• Obie Awards
• Joseph Jefferson Awards

Major British award organizations include the Olivier Awards. The Tony Awards retired the awards for Sound Design as of the 2014-2015 season,^[24] then reinstated the categories in the 2017-18 season.^[18]

See also

• Audio engineering
• Berberian Sound Studio
• Crash box
• Director of audiography
• List of sound designers
• Musique concrète
• IEZA Framework – a framework for conceptual game sound design

References

1. Brazell, Karen (1999). Traditional Japanese Theater. Columbia University Press. ISBN 0-231-10873-7.
2. Kaye, Deena; Lebrecht, James (1992). Sound and Music For The Theatre. Back Stage Books, an imprint of Watson-Guptill Publications. ISBN 0-8230-7664-4.
3. Booth, Michael R. (1991). Theatre In The Victorian. Cambridge University Press. ISBN 0-521-34837-4.
4. Napier, Frank (1936). Noises Off. Frederick Muller.
5. "Sound designer". FilmSound.org. Retrieved 13 October 2015.
6. Ondaatje, Michael; Murch, Walter (2003). The conversations: Walter Murch and the art of editing film. London: Bloomsbury. p. 53.
7. Reeves, Alex. . Advertising Week Social Club. Advertising Week. Archived from the original on 4 March 2016. Retrieved 13 October 2015.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
8. Bordwell, David. "William Cameron Menzies: One Forceful, Impressive Idea". davidbordwell.net. Retrieved 13 October 2015.^{[self-published source?]}
9. "Dolby Atmos for content creators". from the original on October 8, 2021. Retrieved January 6, 2022.
10. Müller, Bastian (2008). Sound Design: The Development of Sound Design for Hollywood Films and its Impact on Modern Cinema. Hamburg: diplom.de. p. 24. ISBN 9783836618922. Retrieved 13 October 2015.
11. Hollyn, Norman (2009). The Film Editing Room Handbook: How to Tame the Chaos of the Editing Room. Berkeley CA: Peachpit Press. p. 144. ISBN 978-0321679529. Retrieved 13 October 2015.
12. Dakic, Vesna (2009). Sound Design for Film and Television. Norderstedt: GRIN Verlag. p. 2. ISBN 9783640454792. Retrieved 13 October 2015.
13. Dugan, Dan (December 1969). "A New Music and Sound Effects System for Theatrical Productions". Journal of the Audio Engineering Society. Audio Engineering Society. 17 (6): 666–670. Retrieved March 23, 2011.
14. Kaye, Deena; LeBrecht, James (2009). Sound and music for the theatre: the art and technique of design. Focal Press. p. 8. ISBN 978-0-240-81011-9.
15. "How to License Music". from the original on January 1, 2021. Retrieved January 6, 2022.
16. "How to succeed in Theater Sound Design, Podcast Sound Design, and Podcast Production – with Kirsty Gillmore, Jeff Schmidt, and Matthew McLean". 8 January 2020. from the original on August 5, 2020. Retrieved January 6, 2022.
17. (PDF). American Theatre Wing. Archived from the original (PDF) on 19 March 2012. Retrieved 26 December 2011.
18. "Best Sound Design Categories to Return to the Tony Awards". TonyAwards.com. Retrieved 2017-04-27.
19. [1]
20. Gal, Viviane; Le Prado, Cécile; Merland, J. B.; Natkin, Stéphane; Vega, Liliana (September 2002). "Processes and tools for sound design in computer games". Proceedings of International Computer Music Conference. Goetborg. CiteSeerX 10.1.1.78.5543..
21. Veneri, Olivier; Natkin, Stéphane; Le Prado, Cécile; Emerit, Marc. "A Game Audio Technology Overview" (PDF).
22. "About Audio Middleware". 9 March 2016. from the original on May 30, 2021. Retrieved January 6, 2022.
23. Jones, Kenneth (19 Jun 2007). . Playbill.com. Archived from the original on 2007-06-26. Retrieved 2008-06-23.
24. Bowgen, Phillipe. "Tony Award Administration Committee Eliminates Sound Design Categories", Playbill, June 11, 2014

External links

• FilmSound.org: A Learning Space dedicated to the Art of Sound Design
• Kai's Theater Sound Hand Book
• Association of Sound Designers
• sounDesign: online publication about Sound Communication