Digital Audio and Sound Characteristics in Multimedia
3.1 Characteristic of sound and
digital audio.
Sound is based on two things:
Energy and Transport
Medium
Energy from a banging drum is converted into pressure
that is transmitted by the air
There are two characteristic of sound waves
Amplitude:
Amplitude is the power or intensity of the sound
The louder the sound, the larger the amplitude
Frequency:
Frequency is the rate at which sound is measured
It is measured in cycles per second or Hertz (Hz)
3.2. Voice and Music
There are three classes of sound
Voices
Music &
Sound effects
Voice is defined as talking, not singing by human. It
does not have a pitch and tone
Music can have rapid changes in tone and pitch. It is
usually recorded and played in stereo
Sound effects can be voice or music. It is vary in tone,
pitch and time.
3.3. Digitizing Sound
Digitizing sound means capturing the sound amplitude at a
specific frequency
The three characteristics for recording sound
Frequency rate
Amplitude measurement
Sound channels (Monaural or stereo)
For multimedia computers, standard frequency rate includes
11.025 Kilohertz (KHz)
22.5 KHz
44.1 KHz
Amplitude measurements is based on 8 bits (1 byte) for 256
levels and 256 bits for 65,536 levels.
3.4 Calculating Audio Data Size
There are three characteristics are used to calculating
audio file sizes. Which are
amplitude
,
sound channels
and
frequency rates
C=number of channels (mono -1 channel and stereo –
2 channel)
S= Sampling rate in Hertz (cycle per second)
T=a time (second)
B= bytes (1 for 8-bit and 2 for 16-bit)
3.5. Digital Audio System
Digital audio created when the characteristics of sound
wave is represent using number – a process referred to a
Digitizing.
We can digitize any sound (Microphone, Synthesizer..)
Digitized sound is sample sound
Every n
th
fraction of second , a sample of sound is taken
and stored as digital information in bits and bytes.
The quality of digital recording depends on the how often
the sample are taken.
i.e. Higher the sampling rate better is the quality of sound
Sampling rates are normally used in multimedia 44.1
KHz (CD-Quality), 22.05 KHz and 11. 025 KHz
Larger the sample size, more accurate data will
describe the recorded sound
The value of each sample is rounded off to the
nearest integer called quantization
.
Digital Audio Software Support
Play back
Record
Stop
Fast forward
Reverse
Rewind
3.6 . Editing Digital Audio
Trimming the clip
Deleting dead space (areas without sound) at the
beginning and end of the record
it helps to reduce the file size
Splicing and Assembly
:
if your extraneous noise when play back the recorder
audio, you may want to identify the location of the
extraneous noise in the wave front to select then cut
it
Volume Adjustment:
increase and decrease the volume
of the sound.
3.6. Sound control
Multimedia controls usually have software that acts
as a control for the computers sound playback and
recording . This software includes :
Selection of components (Microphone, Speaker, Line-
in , line-out)
Volume level, both monaural and stereo
Recording input level
Bass and treble controls
These controls are usually accessible for a user from
the operating system of the computer as well as
within multimedia products themselves.
MIDI (Musical Instrument
Digital Interface)
It is a communication standard developed in 1980’s for
electronic instruments and computers
It allows the instruments from different manufactures to
communicate.
But MIDI data is not digitized, it is only music data stored
in numeric form.
Digital audio is recorded where as MIDI is a score
Device independent file.
This file is a list of time stamped commands that are
recordings of musical actions.
Digital Audio Workstation
Using MIDI, we can easily and quickly compose our own
original score
The process of creating MIDI is quite different from
digitizing a recorded audio
For digitized audio we simple need to play the recording
through a computer device that can digitally record the
sound
To make MIDI , we need
Notation Software
Sequencer software
Synthesizer
MIDI keyboard
MIDI Vs DIGITAL AUDIO
ADVANTAGES
MIDI files are more compact than audio files
MIDI is small, can be easily embedded into the web pages
MIDI sound source is high quality, this sound better than
audio files.
MIDI data is completely editable
MIDI data can be easily converted to musical notations
and vise versa.
3.7 AUDIO FILE FORMAT
A file system format is a recognized methodology for
compressing data bits of digitized sound into data file
The structure of the file must be known even before
the data can be saved or loaded into computer to be
edited or played as sound
The file name extension identifies the method of
storage used
Macintosh: AIFF, and AIFC
Windows : WAV. Mp3,
MIDI support both files (. Mid)
3.9 Using Audio in multimedia
application
Adding sound to multimedia project & the following
step
Determine the file format that are compatible with MM
authoring software
Determine the sound playback capabilities that the end
user’s system offers
Decide the type of sound needed
Decide where want to use the digital audio or MIDI data
Acquire source material by creating it from scratch or
buying it
Edit the sounds to fit your project
Test the sounds to be sure they are timed properly with
the projects images.
3.9 . Audio Quality
3.9.1. intensity
3.9.2. duration
3.9.3 frequency
3.9.1. Intensity (Volume)
The intensity of audio / sound measured in decibels
(DB)
The intensity of the sound / audio depends on the
amplitude
of the sound waves
Amplitude is the size of the vibration and this
determines how loud the sound/ audio is.
3.9.2 Duration
The duration of a sound/audio depends on the
persistence of the sound wave
(i.e) the amount of time in which the vibration is
extinguished (eliminated).
Highest Persistence :
longest sound / audio
Lowest Persistence :
shortest sound
3.9.3 . Frequency
Frequency , the perception of a high or low
sound/audio, is measure in Hertz (Hz)
Frequency is the speed of the vibration .
Highest frequency:
longest sound / audio
Lowest frequency :
shortest sound
3.10. Audio for Managing –
Software function
Realtek's High Definition Audio Driver
is one of
the most used sound
drivers
which provides
high
-
quality DTS (Digital Theater Systems,), Dolby,
Surround Sound.
Realtek HD Audio Driver
is typically required for
your
audio
device to be in working condition.
3.2 Digital
3.2 Digital
Video
Video
& Animation
& Animation
3.2.1 Background on video
Video is an excellent tool for delivering multimedia.
Video places the highest performance demand on
computer and its memory storage
Digital video has replaced analog video as the method
of choice for making and delivering video for
multimedia.
3.2.2 Source of digital video
1. Converting existing analog video to digital
2. create or purchase digital footage
3.2. making digital from analog
Sampling from existing analog sources
VCR
Laserdisc
Require digitizing boards on computer s
Sample the electrical currents produced by playing the
analog image and sound sources. (PC: 55-250 watts)
Store the resulting voltage levels as digital values
Video camera can “record” directly from an analog source
to make a digital video
1080i ( Interlaced Video)- Definition
Interlaced video is a technique for doubling the
perceived frame rate of a video display without
consuming extra bandwidth.
The interlaced signal contains two fields of a video
frame captured consecutively.
3.2.2 Types of analog video
1.Component
2.Composite
3.S-Video (Separated – Video)
Component video
is an analog video-only signal that is
transmitted as three separate signals.
Component-video cables often paired with audio cables.
Component video is capable of carrying signals such as
480i (interlaced scan) , 720p, and 1080i and most high-
definition TVs support the use of component video up to
their native resolution.
3.2.4. Digital Video
Digital video is the digitization of analogue video signals
into numerical format
It creates the illusion of full motion by displaying a rapid
sequences of changing images on a display device.
Conversion from analog to digital format requires the use
on an ADC (A to D )
A digital to analog converter (D to A) can be used to output
digital video on analog equipment
3.2.4. Digital Video (cont..)
Video clip stored on any mass-storage device can be
played on a computer’s monitors without special
hardware
Setting up production environment for making digital
video, requires some hardware specifications.
Some specifications include computer with Firewire
connections and cables, fast processor, plenty of RAM
,fast and big hard disk.
3.2.5.Characteristics of digital
video
Frame Rates
Frame Size
Color Depth or Resolution
1. Frame Rate
Animation is an illusion caused by the rapid display of
still images.
Television and movies play at 30 fps
2. Frame Size
A standard full screen resolution is 640 x 480 pixels
but to safe storing space a video with 320 x 240 for a
computer display is still acceptable
New high-definition televisions (HDTV) are capable of
resolutions up to 1920 x 1080 pixel- 60 frames per
second
3.Color depth or resolution
The quality of video is dependent on the color quality
( related to the number of colors) for each bitmap in
the frame sequence
3.Color depth or resolution
The color depth below 256 colors is poorer – quality
images
The frame rate to below 15 fps causes a notice able
and distracting jerkiness that unacceptable
Changing the image size and compressing the file
therefore become primary ways of reducing file size.
3.2.6 DIGITAL VIDEO DATA SIZING
The amount of storage needed to capture and manage
digital video can be staggering
Graphic image that is 640 by pixels with bit color
requires nearly one megabyte for storage
One minute require nearly 1,620 mega bytes.
3.2.7. Calculating the size of a
digital video stream
Calculate the size of a value data stream
f = frame size ( width * height)
r= frame rate ( frames per second)
c= color depth ( in bytes)
t= time in seconds
Raw video data size = f * r * c * t
3.2.8. Managing Digital Video file
size
To reduce the amount of data down to a manageable
level we must one or more of the video characteristics
Frame rate
Frame size
Color depth
3.2.8. Managing Digital Video file
size (cont..)
Reduce the frame rate of 15 frames per second and the
frame size to 320 by 240 pixels
Height times width: 320 pixels times 240 Pixels = 76,800
total pixels per frame X 3 bytes per pixel=230,400 total
bytes per frame X 15 frames per second = 3,456,000 total
bytes per second times X 60 second = 207,360,000 bytes
( 1 minute)
3.2.9. Video capture and playback
system
Digital video is based on a combination of hardware
and software to capture, store, edit, and play back
digital video.
Video source such as a camera or video cassette
recorder (VCR) capable of producing NTSC( National
television system committee), PAL ( Phase Alternating
Line), or other compatible video signal.
3.2.9. Video capture and playback
system (cont..)
Analog to Digital Converter:
Converting the analog video stream into a digital
video stream
the digital video stream is a series of bits and bytes
that represent the images from a video source
Audio capture circuitry:
Sound capture device the operates concurrently
with the video capture system
3.2.10. Digital Video Software
Each application that depends on digital video
responsible for all aspects of controlling video capture
hardware, compression and playback
Software drives with the operating system the video
capture, compression, and playback
Digital video software comes in the basic forms
Video capture
Video editing
Video playback for application
3.2.11 . Computer Animation
The use of computer generated ages to convey motion.
Digital video is based on capture video from a camera
Creating a series of still images that can be store
rapidly creating a sense of motion
Manipulating and moving an object along a vector
path
Storing animation information in a data file for
playback
3.2.12. Creating Animation
The previous image with a minute change that over
time and rapid playback presents an illusion of by the
content of the segment.
Animation software tools enable developers to rapidly
build a succession of images by group object and
managing backgrounds.
32.13.Object based Animation
Creating animation is the two or three dimensional
representation of real world objects
Objects can be manipulated by modifying the
behavior of the elements within the objects.
This content delves into key aspects of digital audio and sound characteristics in the realm of multimedia technology. It covers topics such as the nature of sound waves, the classes of sound including voice and music, digitizing sound, calculating audio data sizes, and the creation of digital audio systems. The discussion explores fundamental concepts like amplitude, frequency, sound channels, and sampling rates essential in capturing and reproducing sound accurately in the digital domain.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
3.1 Digital Audio
3.1 Characteristic of sound and digital audio. Sound is based on two things: Energy and Transport Medium Energy from a banging drum is converted into pressure that is transmitted by the air There are two characteristic of sound waves Amplitude: Amplitude is the power or intensity of the sound The louder the sound, the larger the amplitude Frequency: Frequency is the rate at which sound is measured It is measured in cycles per second or Hertz (Hz)
3.2. Voice and Music There are three classes of sound Voices Music & Sound effects Voice is defined as talking, not singing by human. It does not have a pitch and tone Music can have rapid changes in tone and pitch. It is usually recorded and played in stereo Sound effects can be voice or music. It is vary in tone, pitch and time.
3.3. Digitizing Sound Digitizing sound means capturing the sound amplitude at a specific frequency The three characteristics for recording sound Frequency rate Amplitude measurement Sound channels (Monaural or stereo) For multimedia computers, standard frequency rate includes 11.025 Kilohertz (KHz) 22.5 KHz 44.1 KHz Amplitude measurements is based on 8 bits (1 byte) for 256 levels and 256 bits for 65,536 levels.
3.4 Calculating Audio Data Size There are three characteristics are used to calculating audio file sizes. Which are amplitude, sound channels and frequency rates C=number of channels (mono -1 channel and stereo 2 channel) S= Sampling rate in Hertz (cycle per second) T=a time (second) B= bytes (1 for 8-bit and 2 for 16-bit) FILE SIZE = C * S * T * B
3.5. Digital Audio System Digital audio created when the characteristics of sound wave is represent using number a process referred to a Digitizing. We can digitize any sound (Microphone, Synthesizer..) Digitized sound is sample sound Every nth fraction of second , a sample of sound is taken and stored as digital information in bits and bytes. The quality of digital recording depends on the how often the sample are taken. i.e. Higher the sampling rate better is the quality of sound
Sampling rates are normally used in multimedia 44.1 KHz (CD-Quality), 22.05 KHz and 11. 025 KHz Larger the sample size, more accurate data will describe the recorded sound The value of each sample is rounded off to the nearest integer called quantization.
Digital Audio Software Support Play back Record Stop Fast forward Reverse Rewind
3.6 . Editing Digital Audio Trimming the clip Deleting dead space (areas without sound) at the beginning and end of the record it helps to reduce the file size Splicing and Assembly: if your extraneous noise when play back the recorder audio, you may want to identify the location of the extraneous noise in the wave front to select then cut it Volume Adjustment: increase and decrease the volume of the sound.
3.6. Sound control Multimedia controls usually have software that acts as a control for the computers sound playback and recording . This software includes : Selection of components (Microphone, Speaker, Line- in , line-out) Volume level, both monaural and stereo Recording input level Bass and treble controls These controls are usually accessible for a user from the operating system of the computer as well as within multimedia products themselves.
MIDI (Musical Instrument Digital Interface) It is a communication standard developed in 1980 s for electronic instruments and computers It allows the instruments from different manufactures to communicate. But MIDI data is not digitized, it is only music data stored in numeric form. Digital audio is recorded where as MIDI is a score Device independent file. This file is a list of time stamped commands that are recordings of musical actions.
Using MIDI, we can easily and quickly compose our own original score The process of creating MIDI is quite different from digitizing a recorded audio For digitized audio we simple need to play the recording through a computer device that can digitally record the sound To make MIDI , we need Notation Software Sequencer software Synthesizer MIDI keyboard
MIDI Vs DIGITAL AUDIO ADVANTAGES MIDI files are more compact than audio files MIDI is small, can be easily embedded into the web pages MIDI sound source is high quality, this sound better than audio files. MIDI data is completely editable MIDI data can be easily converted to musical notations and vise versa.
3.7 AUDIO FILE FORMAT A file system format is a recognized methodology for compressing data bits of digitized sound into data file The structure of the file must be known even before the data can be saved or loaded into computer to be edited or played as sound The file name extension identifies the method of storage used Macintosh: AIFF, and AIFC Windows : WAV. Mp3, MIDI support both files (. Mid)
3.9 Using Audio in multimedia application Adding sound to multimedia project & the following step Determine the file format that are compatible with MM authoring software Determine the sound playback capabilities that the end user s system offers Decide the type of sound needed Decide where want to use the digital audio or MIDI data Acquire source material by creating it from scratch or buying it Edit the sounds to fit your project Test the sounds to be sure they are timed properly with the projects images.
3.9 . Audio Quality 3.9.1. intensity 3.9.2. duration 3.9.3 frequency
3.9.1. Intensity (Volume) The intensity of audio / sound measured in decibels (DB) The intensity of the sound / audio depends on the amplitude of the sound waves Amplitude is the size of the vibration and this determines how loud the sound/ audio is.
3.9.2 Duration The duration of a sound/audio depends on the persistence of the sound wave (i.e) the amount of time in which the vibration is extinguished (eliminated). Highest Persistence : longest sound / audio Lowest Persistence : shortest sound
3.9.3 . Frequency Frequency , the perception of a high or low sound/audio, is measure in Hertz (Hz) Frequency is the speed of the vibration . Highest frequency: longest sound / audio Lowest frequency : shortest sound
3.10. Audio for Managing Software function Realtek's High Definition Audio Driver is one of the most used sound drivers which provides high- quality DTS (Digital Theater Systems,), Dolby, Surround Sound. Realtek HD Audio Driver is typically required for your audio device to be in working condition.
3.2 Digital Video & Animation
3.2.1 Background on video Video is an excellent tool for delivering multimedia. Video places the highest performance demand on computer and its memory storage Digital video has replaced analog video as the method of choice for making and delivering video for multimedia.
3.2.2 Source of digital video 1. Converting existing analog video to digital 2. create or purchase digital footage
3.2. making digital from analog Sampling from existing analog sources VCR Laserdisc Require digitizing boards on computer s Sample the electrical currents produced by playing the analog image and sound sources. (PC: 55-250 watts) Store the resulting voltage levels as digital values Video camera can record directly from an analog source to make a digital video
1080i ( Interlaced Video)- Definition Interlaced video is a technique for doubling the perceived frame rate of a video display without consuming extra bandwidth. The interlaced signal contains two fields of a video frame captured consecutively.
3.2.2 Types of analog video 1.Component 2.Composite 3.S-Video (Separated Video) Component video is an analog video-only signal that is transmitted as three separate signals. Component-video cables often paired with audio cables. Component video is capable of carrying signals such as 480i (interlaced scan) , 720p, and 1080i and most high- definition TVs support the use of component video up to their native resolution.
3.2.4. Digital Video Digital video is the digitization of analogue video signals into numerical format It creates the illusion of full motion by displaying a rapid sequences of changing images on a display device. Conversion from analog to digital format requires the use on an ADC (A to D ) A digital to analog converter (D to A) can be used to output digital video on analog equipment
3.2.4. Digital Video (cont..) Video clip stored on any mass-storage device can be played on a computer s monitors without special hardware Setting up production environment for making digital video, requires some hardware specifications. Some specifications include computer with Firewire connections and cables, fast processor, plenty of RAM ,fast and big hard disk.
3.2.5.Characteristics of digital video Frame Rates Frame Size Color Depth or Resolution
1. Frame Rate Animation is an illusion caused by the rapid display of still images. Television and movies play at 30 fps
2. Frame Size A standard full screen resolution is 640 x 480 pixels but to safe storing space a video with 320 x 240 for a computer display is still acceptable New high-definition televisions (HDTV) are capable of resolutions up to 1920 x 1080 pixel- 60 frames per second
3.Color depth or resolution The quality of video is dependent on the color quality ( related to the number of colors) for each bitmap in the frame sequence
3.Color depth or resolution The color depth below 256 colors is poorer quality images The frame rate to below 15 fps causes a notice able and distracting jerkiness that unacceptable Changing the image size and compressing the file therefore become primary ways of reducing file size.
3.2.6 DIGITAL VIDEO DATA SIZING The amount of storage needed to capture and manage digital video can be staggering Graphic image that is 640 by pixels with bit color requires nearly one megabyte for storage One minute require nearly 1,620 mega bytes.
3.2.7. Calculating the size of a digital video stream Calculate the size of a value data stream f = frame size ( width * height) r= frame rate ( frames per second) c= color depth ( in bytes) t= time in seconds Raw video data size = f * r * c * t
3.2.8. Managing Digital Video file size To reduce the amount of data down to a manageable level we must one or more of the video characteristics Frame rate Frame size Color depth
3.2.8. Managing Digital Video file size (cont..) Reduce the frame rate of 15 frames per second and the frame size to 320 by 240 pixels Height times width: 320 pixels times 240 Pixels = 76,800 total pixels per frame X 3 bytes per pixel=230,400 total bytes per frame X 15 frames per second = 3,456,000 total bytes per second times X 60 second = 207,360,000 bytes ( 1 minute)
3.2.9. Video capture and playback system Digital video is based on a combination of hardware and software to capture, store, edit, and play back digital video. Video source such as a camera or video cassette recorder (VCR) capable of producing NTSC( National television system committee), PAL ( Phase Alternating Line), or other compatible video signal.
3.2.9. Video capture and playback system (cont..) Analog to Digital Converter: Converting the analog video stream into a digital video stream the digital video stream is a series of bits and bytes that represent the images from a video source Audio capture circuitry: Sound capture device the operates concurrently with the video capture system
3.2.10. Digital Video Software Each application that depends on digital video responsible for all aspects of controlling video capture hardware, compression and playback Software drives with the operating system the video capture, compression, and playback Digital video software comes in the basic forms Video capture Video editing Video playback for application
3.2.11 . Computer Animation The use of computer generated ages to convey motion. Digital video is based on capture video from a camera Creating a series of still images that can be store rapidly creating a sense of motion Manipulating and moving an object along a vector path Storing animation information in a data file for playback
3.2.12. Creating Animation The previous image with a minute change that over time and rapid playback presents an illusion of by the content of the segment. Animation software tools enable developers to rapidly build a succession of images by group object and managing backgrounds.
32.13.Object based Animation Creating animation is the two or three dimensional representation of real world objects Objects can be manipulated by modifying the behavior of the elements within the objects.
