Multimedia Lecture 01

1. MIT 628: Multimedia Technology
Dr. Kritsada Sriphaew
Master of Science in Information Technology
Rangsit University

2. 1 Multimedia Systems, Standards and Trends
MPEG and Visual Display Unit
2 MPEG-4 standards
3 Image Technology, JPEG standards
4 Encoding and Compression
5 Video Indexing and Retrieval
Content-Based Image Retrieval
6 Speech/Audio Processing for Multimedia
Applications
7 Speech Recognition
8

3. 9 Handwritten Recognition
10 Interactive Multimedia Systems
11 Multimedia Hardware, Software and Authoring
Tools
12 Design, Development and Evaluation of
Interactive Multimedia Systems
13 Open Topic 1 (tentative HTML5/CSS3 or Flash)
14 Open Topic 2 (tentative HTML5/CSS3 or Flash)
15 Mobile Multimedia Technology
16
17

4. What is Multimedia?
• Multimedia: a working definition
– A combination of two or more categories of
information having different transport signal
characteristics
– Typically, one medium is a continuous medium
while another is discrete
– Image, audio, video and graphics are examples of
media

5. Videos
• Some issues
– How are the temporal relations between the
media represented?
– What do I need to stream video across the
network?
– Are the different media synchronized?
– How can I describe a video retrieval request
like a query?

6. Background
• MPEG : Moving Picture Experts Group
“Compactly representing digital video and audio
signal for consumer distribution”
ISO/IEC Standard
• ITU-T : International Telecom Union
The ITU Telecommunication Standardization Sector
Some standards for MPEG and ITU-T are duplicate

7. MPEG Standards
• MPEG-1: (1993) Standard for VCD
“Coding of moving pictures and associated audio for
digital storage media at up to about 1.5 Mbit/s”
• MPEG-2: (1995) Standard for SVCD, DVD, digital
TV
“Generic coding of moving pictures and associated
audio information”
• MPEG-3: intention for Standard of HDTV
– Found Redundant and merge with MPEG-2, there is no MPEG-3 standard
– It is not MP3, which is MPEG-1 Audio Layer III.

8. MPEG Standards
• MPEG-4: (1998)
“Coding of audio-visual objects for 3D or more efficient video”
“closer to computer graphics applications”
• MPEG-4 Part 2: visual objects format vdo
– DivX
– XviD
• MPEG-4 Part 3: audio
– AAC (Advance Audio Coding) Implemented by Apple Inc. AAC is referred to have
low bitrate at kbps with the quality equal to MP3 at kbps and applying
in iTunes Music Store with the file format as aac, .mp4 and m4a
• MPEG-4 Part 10: Advanced Video Coding (AVC)
– H.264 (ITU-T) or AVC (MPEG) Higher standard for vdo codec than MPEG-4 part
2. Applying in QuickTime 7 MacOSX 10.4 Tiger, and broadcasting digital TV
in Japan and Europe and next generation of disk for Blu-ray and HD-DVD

9. MPEG Standards
• MPEG-7: (2002) Standard for Adding Contents
(Semantic) to the Media
“Multimedia content description interface”
• MPEG-21: (2001) Standard for Adding Contents
to the Media in a more detail (Frame by Frame)
“Multimedia Framework”

10. MPEG-1 MPEG-2 MPEG-4
1993 1995 1998
352 x 288 720 x 576 1920 x 1152
352 x 288 720 x 576 720 x 576
PAL)
352 x 288 640 x 480 640 x 480
NTSC)
48 kHz 96 kHz 96 kHz
2 8 8
3 Mbit/sec 5 to 10 Mbit/sec 80 Mbit/sec .
1380 kbit/s 880 kbit/s 6500 kbit/s
(352 x 288) (720 x 576) (720 x 576)
25 25 25
PAL)
30 30 30
NTSC)
satisfactory good to very good verygood

11. Visual Display Unit

12. HDTV
• HDTV ( High Definition Television )
HDTV
p
Progressive Scan non-interlaced i
interlaced i p
p HDTV
Widescreen )

13. Full HD and HD Ready
HD Ready
Full HD x768 x768
x720
• HD Ready
input HDMI
Full HD ( 1080i p)
• Blu-ray Full HD 1920x1080
(pixels)
HD x720 (pixels)
Down Scale Native Resolution
x1080 pixels (1,080

14. Interlace and Progressive
• i Interlace
Field 1)
Filed 2)
PAL-576i, NTSC-480i)
• p Progressive

15. TV and Monitor
• CRT Scanline
i (720 x 480)
scanline
pixels
interlace ( p
Progressive)
• LCD Plasma x 480
pixel

16. Resolution of TV
• SDTV : Standard Definition Television
(
)
i, 576i
– NTSC 525x858
480x720 (2:3) (
– PAL/SECAM 576x720 (3:4)
( )
• EDTV : Enhanced Definition Television
p, 576p, 720i
• HDTV : High Definition Television

17. Current Technology for TV
• field A,B
50Hz Hz Sony-
DRC100, Philips 100Hz, 100Hz Digital Scan
• Progressive Scan interlace field A,B
deinterlace progressive
Sony DRC Progressive interlace
•
Sony-DRC1250
• Hybrid
Philips-Pixel Plus
• Progressive Scan ( Progressive scan