Unit 73: Sound for Computer Games-Understand the methods and principles of sound design and production

P2 Understand the methods and principles of sound design and production.
Exercise 1

Research and explain when you would use the following sound formats and why?

Sound file formats

Uncompressed

wav File

The WAV file one of the simplest digital audio file formats. Microsoft and IBM originally developed WAV in 1991 for the use within Windows 3.1. Remember the first time you heard your PC making ‘chime’ noises, and not just beeps? Well, that’s courtesy of the WAV file.

Without getting too geeky, the WAV was derived from the RIFF (resource interchange file format), which stored data in indexed chunks (interesting, eh?). Apple derived its own version of this file format in 1988: AIFF. Essentially, AIFFs are the apple equivalent of WAVs.

They work by taking an audio signal and converting it to binary data. To do this, a device called an analogue to digital converter (AD) takes snapshot ‘slices’ thousands of times per second. For example, CD quality audio records at 44.1kHz, meaning it records at 44,100 slices per second. This makes it capable of recording the entire audible frequency range of 20hz-20khz.

aiff File

The aiff is a file extension for an Audio Interchange File format. AIF is an audio format used by Silicon Graphics and Macintosh applications.

In Windows, the extension for this file type is usually AIF. On a Mac, the file extension is not needed but when present may be AIFF. A Mac file uses a Type and Creator resource to identify itself to the operating system and the applications that can open it.

AIFF is one of the two most common audio file formats used in the Apple Macintosho perating system. The other is Sound Designer II (SDII). Most CD writers can accept AIFF or SDII files interchangeably when writing a Red Book audio CD. AIFF is sometimes referred to as "Apple Interchange File Format."

An AIF file contains the raw audio data, channel information (monophonic or stereophonic), bit depth,sample rate, and application-specific data areas. The application-specific data areas let different applications add information to the file header that remains there even if the file is opened and processed by another application.

MIME type: audio/aiff, audio/x-aiff, sound/aiff, audio/rmf, audio/x-rmf, audio/x-pn-aiff, audio/x-gsm, audio/mid, audio/x-midi, audio/vnd.qcelp

au File

(AUdio file) A digital audio file format from Sun that is used on the Internet and can be played by a Java program. It provides toll-quality sound and uses the .AU extension. It generally uses the u-Law (mu-Law) encoding method, and raw u-Law files and AU files are the same except for the file header.

smp File

The smp file extension is associated with AutoCAD Civil Building Information Modeling (BIM) software for civil engineering design and documentation, developed by Autodesk.

The smp file stores sampled station list.

voc File

Files that contain the .voc file extension are most commonly associated with Creative Labs audio hardware devices. The VOC files contain audio files that are used by the associated Creative Labs hardware.

VOC files can contain audio clips, music files, instrument sounds and sound effects that are used with the associated hardware device. The VOC file format is a compressed file format, allowing for a reduction in the size of the audio file that is stored on the user's hard drive.

The Quartet software application has also been known to use the .voc file suffix for similar purposes. These VOC files contain audio files that are used by the Quartet program.

The .voc file format is also used by the ZX Spectrum software application. These VOC files contain tape image files that are created with the ZX Spectrum software.

Lossy compression

mp3 File

MP3 (MPEG-1 Audio Layer-3) is a standard technology and format for compressing a sound sequence into a very small file (about one-twelfth the size of the original file) while preserving the original level of sound quality when it is played. MP3 provides near CD quality audio.

ra File

RA is a file extension for a streaming audio file format used by RealNetworks' RealPlayer. An RA file generally contains audio data encoded in the proprietary RealAudio codec.

vox File

Dialogic ADPCM or VOX is an audio file format, optimized for storing digitized voice data at a low sampling rate. VOX files are most commonly found in telephony applications, as well as an occasional arcade redemption game.

Audio Sampling

How can resolution and bit-depth constrain file size?
In digital audio using pulse-code modulation (PCM), bit depth is the number of bits of information in each sample, and it directly corresponds to the resolution of each sample. Examples of bit depth include Compact Disc Digital Audio, which uses 16 bits per sample, and DVD-Audio and Blu-ray Disc which can support up to 24 bits per sample.

In basic implementations, variations in bit depth primarily affect the noise level from quantization error—thus the signal-to-noise ratio (SNR) and dynamic range. However, techniques such as dithering, noise shaping and oversampling mitigate these effects without changing the bit depth. Bit depth also affects bit rate and file size.

Bit depth is only meaningful in reference to a PCM digital signal. Non-PCM formats, such as lossy compression formats, do not have associated bit depths. For example, in MP3, quantization is performed on PCM samples that have been transformed into the frequency domain.

Explain what the following words mean:

Sample rate -Sample rate is the number of samples of audio carried per second, measured in Hz or kHz (one kHz being 1 000 Hz). For example, 44 100samples per second can be expressed as either 44 100 Hz, or 44.1 kHz. Bandwidth is the difference between the highest and lowest frequencies carried in an audio stream

Mono-Mono uses one, stereo uses more than one. In monaural sound one single channel is used. It can be reproduced through several speakers, but all speakers are still reproducing the same copy of the signal. In stereophonic sound more channels are used (typically two).

Stereo-This is usually achieved by using two or more independent audio channels through a configuration of two or more loudspeakers (or stereo headphones) in such a way as to create the impression of sound heard from various directions, as in natural hearing.

Surround-Surround sound is a term used to describe a type of audio output in which the sound appears to "surround the listener" by 360 degrees. Surround sound systems use three or more channels and speakers in front and behind the listener to create a surrounding envelope of sound and directional audio sources. The term surround sound has become popular in recent years and more commonly used since the advent of home theater systems. Surround sound can be either an analog or digital system.

Audio Limitations of Games Platforms

DSP – Digital Signal ProcessorRAM – Random Access Memory.

A digital signal processor DSP is a specialized microprocessor or a SIP block, with its architecture optimized for the operational needs of digital signal processing. The goal of DSPs is usually to measure, filter and/or compress continuous real-world analog signals.

File format (eg Mp3, Wav, Aiff)-Limitations
Unlike a bitmap image, a vector image is incapable of reproducing a continuous tone photographic image,Vector images tend to produce an unrealistic image and a more cartoon looking image.
Because a vector file has to load vector software and then open and calculate file paths it can be slow in opening therefore may be unsuited.Audio output (eg Mono, Stereo, Surround)

PCM –Pulse Code Modulation

Pulse-code modulation (PCM) is a method used to digitally represent sampled analog signals. It is the standard form of digital audio in computers, Compact Discs, digital telephony and other digital audio applications.

Film breakdown "Appleseed Alpha" (2014)

Title-Appleseed Alpha

Start

In the beginning of the movie the two main characters (Deunan Knute) and (Briareos Hecatonchires) and working for someone called (Two Horns) there first mission we see is that they are on a train , retrieving the vaccine for (Tow horns),  however as with every "easy" mission things are wrong quickly. After  this the main characters noticed that (Two Horns) had set them up and they want out.


Moving on two horns gets blown up by the main enemy (Talos) but good old (Two Horns) survives.
After this he seeks out  to try and find the girl that (Talos) is looking for.

Middle

The middle begins when the two main characters find two other people Iris() and (Olson) these two turn out to be the "good guys" they fix (Briareos Hecatonchires) and give him his abilities back.

After this (Talos) finds them and he knows about the two main characters helping them complete their mission. AS the four of them approach a city, (Two Horns) tries to kill them all with his tank, however (Iris) blows up his tank with a grenade, and once again (Two Horns) dies.


After the deathwatch between the four heroes (Talos) kid-napes (Iris) and (Olson) after several minutes of threatening them to give the location of the super weapon hes decides to use force on (Olson) and he downloads all his data, shoots him then he falls out of the helicopter and dies.

End

The two other heroes (Deunan Knute) and (Briareos Hecatonchires) find (Olson) dead they seek out to for fill the mission that he had, after this (Talos) eventually finds the super weapon and he gains access, however he has no control over it and the 2 main heroes (Deunan Knute) and (Briareos Hecatonchires) eventually catch up and drive down into the base and try to stop (Talos) however they get pinned down, but good old (Two Horns) comes back again and instead of killing them he saves them.

The reaming heroes all work together try and stop the super weapon, however in doing so the 3rd hero (Iris) dies but the super weapon is destroyed.

Unit 73: Music,FX and legal considerations

Music,FX and legal considerations

P1-Exercise

1. List a range of Music/FX sources.

• Latin                                           Asset store (Royalty free)
• Children`s
• Classical
• Electronic
• Folk
• Jazz
• New age
• R&B
• Stage and Screen
• Vocal
• Rap
• Religious

2. Using at least 3 of your favourite games explain the purpose of game music.
    you need to consider: mood,action,suspense,closing sequence,credit,plot advancement,interactive       adaptive music.

2a) Geometry Dash-All levels have a different tempo and the further you get the game the faster the tempo increases.

2b) Call of duty: Black ops 3, The Easter egg song "The beauty of annihilation" is a track which is played during the map "The Giant" this song encourages the player to carry on killing zombies.

2c) The Elder Scrolls V: Skyrim "Dovakiin. This song is very encouraging to the player to make them feel important and stronger than other enemies.


3. What are the legal considerations needed when obtaining or using Music/FX?
    you can refer back to unit your Unit1/Unit78 tracks.

Copyright and legal issues

• Asset store
• Royalty free music
• Produce your own music
• Buy the rights-Contract agreement
• Copyright

• Of Com-monitor the music air waves(Daddy of music)ASA-Code of conduct
• Cap-Bcap-Advertising standards
• PRS-Performing Rights Service

The Arts Law Centre of Australia and the Australian Copyright Council provides up-to-date resources that cover many of the issues faced by filmmakers.

Copyright law provides that any content used as part of a production must be wholly created by the maker of the film - it should be new and original work. Otherwise written permission must be sought from the copyright-holder agreeing for their work to be included in the production.

All communication with copyright holders must makethe outcomes of the work clear, and where it will be seen.This affects what rights are required and what fees may be charged.

More on the legal and ethical on this link:http://generator.acmi.net.au/resources/legal-and-ethical-issues

Film Breakdown "Survivor" (2015)

Film Title- "Survivor"

A Foreign Service Officer in London tries to prevent a terrorist attack set to hit New York, but is 

forced to go on the run when she is framed for crimes she did not commit.

Motivations for the characters

Assassin-Money

Kate-Revenge for her friends in 911

Business man-Make the dollar "100 Billion"

Characters

·        Ray

·        Johnny Talbot

·        Alvin Murdock

·        Kate

·        Sam

·        Sally

·        Bill

       

       More at

       http://www.imdb.com/title/tt3247714/fullcredits/

       

     Abbott goes on the run (you’ll quickly stop bothering to ask why) and becomes the number one suspect in the duck-breast bombing case. Then things begin to get far-fetched. With her face plastered across television screens, Abbott spends the day meandering through London, catches a flight to New York under the disguise of some spectacles and winds up foiling a terrorist plot to blow up Times Square.

       Beginning

·         Crash helicopter

·         Soldier burned

·         Restaurant big boom-Start of the middle

     

·     Middle

          Assassin

·         Kate wanted

·         Kate goes to new York-Start of the end

    End

·         Time square bomb

·         New year’s eve

·         Kate stops assassin from shooting explosive

·         1million people saved

·         Film Finish 

     The action sequences are good fun, don’t let up for a moment and are generally cleverly shot. And the script wastes no time hurtling into "so-bad-it’s-good" territory: “we believe in that old-fashioned idea of country”; “the place is crawling with marines”. There is even one actual joke: “He’s had so much reconstructive surgery, no-one knows what the hell he looks like,” says one of the good guys. The cut to Brosnan’s taut, twitching face is timed to perfection. 

    The Verdict

Nearly 14 years after the September 11th terrorist attacks, we have seen images of that day used multiple times on the big screen. It can act as a powerful shorthand attempting to explain why our nation has taken various actions (for good or ill). In Survivor, it is used to explain why one person takes her job so seriously and to convince the audience that we are not safe. The film is particularly disappointing as McTeigue also directed V for Vendetta, a much sharper, much more intriguing, much more thought-provoking look at our post-9/11 world.

Story Telling in video games

 Story Telling In Video Games

Task 1

1-Call Of Duty: World at war

3-Fallout 4

2-H1Z1

4-Call Of Duty: Black Ops 3

5-The Elder Scrolls V:Skyrim

6-GMOD

7-Minecraft

8-Borderlands 2

9-Dying Light

10-Red dead redemption

Best Stories are number 5,8 and 9. To begin with The Elder Scrolls V:Skyrim has an amazing vanilla story, giving the player the freedom to create he`s own character his/her trades and they way they complete the story. An add on to this also if you have a pc you can change skyrim to be what ever you like literally if you don`t like dragon for example you can change them all into Thomas the tank engine.

Carrying on Borderlands 2 story is one of a kind it features numerous amounts of puns,quotes,Easter eggs and more a favourite of mine is the character "claptrap" this AI is clearly designed to insult your character no matter how good or bad you do his often phrase is that "your far uglier than i remember minion" alongside this devious character there are other features in the game which make you want to do a "all niter" reason behind this is because the players has the constant urge to kill, loot and repeat, on top this you have got to do "a lot" of farming in this.

Moving on number 9 "Dying Light" this is game which is not for the faint hearted literally because every way you can think of killing a zombie can be done in this game, from drop kicking to dropping an airstrike on them. As far for the story in this game it is really good at drawing the player in making you want to complete the next part and so and so on. Also there are a lot of side missions to this game alongside these there are numerous amount of Easter eggs from the popular series "The Walking Dead"

Red Dead Redemption-Some of the greatest film Westerns deal with the death of the Old West, and Red Dead Redemption strikes gold exploring that subject. Protagonist John Marston is a man out of time. He wants a steady home life, but is pushed back into the saddle by government agents that hate his outlaw past. Marston has to hunt down his old posse of bandits, effectively killing off the last remnants of the era that defined him.

And it’s not just Marston and his former friends that have trouble transitioning into the 20th century. Over and over John meets individuals coming to terms with the end of the West, whether happily or through gritted teeth. Marston himself wants to leave his past behind despite being so good with his revolver, which makes him easier to connect with than every previous Rockstar hero. The ultimate question is: will the world allow him the happy ending he deserves?

Task 2

Games without a story,who plays them? and why?
Games with no story...Minecraft,Pong,Pacman,Tetriz,

The people that play these are mainly causal gamer being so that pong,pacman and tetriz are on most if not all phones.People mainly play these types of games if they have got like 10-15 minutes to wait and they want a time passing game that is enjoyable yo play.

Task 3

What is the difference between a story that is used in a game versus a story used for a book or film?

The first video game I ever fell in love with had no graphics whatsoever. It was all text, and text alone: dim green, amber, or white characters on a dark background—that’s all the earliest monitors could handle. It was a game from the mid-eighties, based on the Douglas Adams novel, “The Hitchhiker’s Guide to the Galaxy.”

Bedroom

The bedroom is a mess.
It is a small bedroom with a faded carpet and old wallpaper.
There is a washbasin, a chair with a tatty dressing gown slung over it, and a window with the curtains drawn. Near the exit leading south is a phone.

Your reward: the treasure of glowing new sentences—sometimes even a long scroll of paragraphs—to read.

By such halting, wonderfully infuriating means you advanced through the game—a game full of jokes! Splendidly goofy, yes, but also a game that would cheerfully annihilate you and return you to the starting point with the cruelty of an affectless, chomping, yellow Pac-Man. (There are many browser-based versions of these old games online if you’d like to try.)

-More on this article

http://www.newyorker.com/books/page-turner/on-video-games-and-storytelling-an-interview-with-tom-bissell

Task 4

Linear and Non-Linear Game line? What does this mean and how can it impact on storytelling in games?

Article about Linear and non-linear game line.

http://www.costik.com/gamnstry.html

Maybe I'm being too restrictive by saying that stories are inherently linear. Perhaps stories have been linear to date because that's all you can do with existing media; text is read sequentially and movies are displayed as linear sequence of frames. Theater has a little more potential interactivity, but conventional theater, at least, deviates from the script only in error.

There are non-linear forms of fiction, like Julio Cortazar's Hopscotch. You can read Hopscotch like a conventional novel, from front to back, the chapters in sequential order; or you can read the chapters in an alternative order proposed by Cortazar. Reading the book in that alternative order is a somewhat different experience; because you encounter events and characters in a different order, the meanings of their actions are different; you see the story in a different light. Indeed, to understand the novel fully, you need to read it in both ways.

That's great, but it's far from unique; modern writers frequently play with the nature of narrative and time. Proust's Remembrance of Things Past is non-linear in time, a sequence of remembrances as they occur to the protagonist. Joyce's Finnegan's Wake is filled with stream-of-consciousness nonsense words that, somehow, make sense in context. Vonnegut's Slaughterhouse Five darts seemingly randomly between the decades. Hopscotch is creative and interesting in the way it plays with the nature of narrative, but so are many other novels.

Linear game play. Sometimes it can mean an excruciatingly simple and trudging story that you can do little to make fun. Other times, it can be one of the most thrilling experiences you can have playing any video game at all. In recent times, some of the best games to be released were largely linear experiences. I speak of course of titles such as Modern Warfare 2 and Uncharted 2: Among Thieves, games that were not focused on giving you a whole-wide world to trudge through and wreak havoc upon, but rather very engaging set pieces with simple goals. I, for one, enjoyed the campaign of Modern Warfare 2 immensely. If I described it to someone, I would call it “the best summer blockbuster you’ll never see in a theater,” and I think that held true for one reason: Linear game play.

Unit 73-Psychology of sound

Task 1

List at least 3 games (or films) which use sound as information (speech, iconography, symbolism and or metaphors) to convey information.

1) Tom & Jerry the movie
2) Sonic the hedgehog
3) Call of duty:World at war,Black ops 1,Black ops 2, Black Ops 3


Speech-Dialogues are a very vital part of any visual media of entertainment, which means video games as well. And the stronger and well-written the dialogues are, the better the story of the game turns out to be. It is believed by many that dialogues are the very backbone of any story, because if the dialogues fall flat, so does the entire narrative, for they are what drive the entire flow forward, lead one thing to the other.

Video games are no different in this aspect, especially the ones these days, what with them having so heavy and complex stories. And with strong speeches showered between regular intervals, a game can truly outshine its competition- if, of course, the speeches are well written and delivered.

Iconography-Iconography is the use of images and symbols to portray a subject, movement or ideal. It can also be the use of certain symbols that convey certain genres such as religious iconography, iconography in art andiconography in film and television.

Symbolism-Silent Hill 2. Practically everything.
I like how it keep the symbolism within its own story instead of going for somewhat fun but pointless real life parallels. I mean, take that human Reaper idea of yours: It's interesting and all, but where does it tie with the story or its themes in any straightforward way?

I suppose you don't lose anything by adding some random symbolism into a story, but I fail to see how they contribute to it either without being relevant to the context.

But anyway, another game is Xenogears. I know, it might seem pretty pretentious with all the ham-fisted Bible references and religious symbols (and some parts really are, like the whole silly crucifixion scene)... But in the end it starts to make sense having all that pointless Judeo-Christian symbolism, when you realize the scope of the story. The plot eventually goes back 10000 years, explaining how the humans came to be on the planet and for what purpose.
You kinda start realizing that all the individually pointless symbolic moments are there to add to the biblical scale of the plot.

Post from escapeistmagazine

http://www.escapistmagazine.com/forums/read/9.179544-Symbolism-in-video-games

Metaphors-A metaphor is a figure of speech that identifies something as being the same as some unrelated thing for rhetorical effect, thus highlighting the similarities between the two.

Unit 73 Sounds for computer games

A)
Listen to at least 5 different pieces of gaming music FX
-Why did the game maker use this music and its sound FX?
-Did it work? If so or not. Why?
-Would you use different music/sound FX and why?

1)
Game: Geometry Dash
Name of Track: Stereo Madness
Link: https://www.youtube.com/watch?v=vBWL8E2xhrg
Purpose of the track-Builds tension towards the player for getting further and further in the level, the track speeds up the longer the player survives.
Type-Retro,funky


2)
Game: Call Of Duty Black Ops 3
Name of track: Beauty Of Annihilation
Link: https://www.youtube.com/watch?v=Zv1BHnCH3TQ
Purpose of the track-A motivation track for the player to continue his/her zombie rampage.
Type-Rock


3)
Game:The Elder Scrolls V:Skyrim
Name of track: Dragonborn
Link: https://www.youtube.com/watch?v=4BUIXq8oblY
Purpose of the track: Sets the mood for skyrim players when player the game.
Type: Encouraging



B)
Research (on-line/journals in library)
-Why is music and sound FX so important within games development?

Purpose of Game Sound Effects

Sound effects have an incredible influence on the overall game experience. While a game may be able to get by without music or dialogue, one without sound effects will be very disappointing.

Sound effects exist specifically to give feedback to players, immerse them inside the virtual realm, and provide an entertaining experience—all of which are key ingredients to a successful video game. Since a game is nothing more than lines of code and pixels of colored light, the sense of sound is what adds warmth and familiarity to what is happening on the screen. Although many current games employ 3D and even hyperrealistic images, the player is still only looking at pixels; the only “real” sense fully experienced by the player is sound. Granted, players aren’t hearing a “real” bird chirp or weapon fire—but the sound they do hear is an actual recording of the real object or a close reproduction of it. Whether it is a “real” sound or not, the impact is the same and the sound plays its specific role.

• Setting the mood: Whether silly or serious, sound effects can help set the appropriate mood of a game through everything from simple button presses to ambience tracks. For example, games designed for the younger crowd, such as Putt-Putt Saves the Zoo, use fun, cartoony sounds to keep the mood light—while horror-themed games such as Resident Evil IV and Doom 3 make effective use of dark, eerie sounds.
• Adding realism: The Medal of Honor series utilizes era-appropriate sounds that create authenticity and help players feel as if they are participating in 1940s conflicts. Sounds associated with weapons, aircraft, and vehicles are specifically designed to match those heard during that particular time in history. Background ambience is also used extensively in these types of games, suggesting that action is taking place all around the character.

More on this article at-http://designingsound.org/2010/10/aaron-marks-special-function-of-game-sound-effects/

C)
What is waveform,(wavelength,amplitude,frequency); pitch;hertz(Hz);decibel level (dB);sound generator(loudspeaker?)

The amplitude, a, of a wave is the distance from the centre line (or the still position) to the top of a crest or to the bottom of a trough. Be careful with this quantity - the centre line is not always given in a diagram. Amplitude is measured in metres (m). The greater the amplitude of a wave then the more energy it is carrying.

The wavelength, λ, of a wave is the distance from any point on one wave to the same point on the next wave along. (The symbol is a Greek letter, 'lambda'.) To avoid confusion, it is best to measure wavelength from the top of a crest to the top of the next crest, or from the bottom of a trough to the bottom of the next trough. Wavelength is also measured in metres (m) - it is a lengthafter all.

The frequency, f, of a wave is the number of waves passing a point in a certain time. We normally use a time of one second, so this gives frequency the unit hertz (Hz), since one hertz is equal to one wave per second.

Don't get confused with this quantity frequency. It is not a distance travelled by waves, nor is it a speed, although it is linked to both of these quantities. For water waves and sound waves the unit hertz is usually good enough but radio and TV waves have such a high frequency that the kilohertz (kHz) or even the megahertz (MHz) are better units.

• 1 kHz = 1,000 Hz
• 1 MHz = 1,000,000 Hz
• http://www.bbc.co.uk/bitesize/standard/physics/telecommunications/communication_using_waves/revision/5/

D)
What is Foley?

 foley

ˈfəʊli/

noun

modifier noun: foley

1. relating to or concerned with the addition of recorded sound effects after the shooting of a film.

   "a foley artist"

Here is short video explaining foley.
https://www.youtube.com/watch?v=OONaPcZ4EAs

E)
What is timbre?

timbre

ˈtambə/

noun

1. the character or quality of a musical sound or voice as distinct from its pitch and intensity.

   "trumpet mutes with different timbres"

   "the Czech orchestra have just the right timbre for Smetana"

   • the distinctive quality or character of someone or something.

     "you must demonstrate your moral timbre as a human being"

Video link for a video about timbre.
https://www.youtube.com/watch?v=BLoM9bBr8lc