Introduction to the MPEG series standards

1. Video Compression Standards
History & Introduction
Champ Yen
champ.yen@gmail.com

2. “
Outline
▷ some concepts
▷ MPEG-1/MPEG-2(H.262)
▷ MPEG4
▷ H.264 (MPEG4 part 10)
▷ HEVC/H.265
▷ Q&A

3. Concepts

4. What is data compression?

5. lossy & lossless compression

6. Information Entropy
But What does Xi mean in Video Coding!?

7. Huffman Coding

8. Frame color format
http://commons.wikimedia.org/wiki/Category:YUV
http://forum.doom9.org/showthread.php?t=167832
YUV444 YUV422 YUV420

9. Basic Sequence/Frame Structure
http://ride.chiariglione.org/MP1_inside.php

10. Motion Compensation

11. quality criteria: PSNR

12. Video Decoding Flow
Entropy
Decode
inverse
Quantization
inverse
Transform
Inter / Intra
Prediction
coef.
data
coef.
data
predicted
frame
residual
decoded
frame
sum &
postproc
reference
frame
reference
frame
reference
frame
01011000101111
pred.
info.

13. Video Encoding Flow
Entropy
Encode
Quantization Transform
Inter / Intra
Prediction
coef.
data
coef.
data
predicted
frame
residual
source
frame
substract
reference
frame
reference
frame
reference
frame
01011000101111
pred.
info.
inverse
Quantization
inverse
Transform
coef.
data
sum &
postproc
residual

14. key-points of Video Coding
▷ Entropy Coding
▷ Coding Unit
▷ Quantization
▷ Transformation
▷ Inter/Intra Prediction
▷ Post-Processing

15. MPEG-1/2

16. MPEG-1/2 overview

17. MPEG1/2 - DCT
http://xiph.org/~xiphmont/demo/daala/demo1.shtml
http://commons.wikimedia.org/wiki/File:DCT-8x8.png
https://vsr.informatik.tu-chemnitz.de/~jan/MPEG/HTML/mpeg_tech.html

18. MPEG1/2 - Quantization
Quantization Matrix
http://en.wikipedia.org/wiki/MPEG-1

19. MPEG1/2 - zigzag scan

20. MPEG1/2 I/P/B frames

21. MPEG1/2 - Bitstream

22. MPEG-4

23. MPEG4 - block mode & inter prediction

24. MPEG4 - DC/AC prediction

25. MPEG4 vs MPEG1/2

26. H.264

27. H.264/AVC - block mode

28. H.264 intra-prediction

29. H.264 inter-prediction
½
¼

30. H.264 - MV prediction

31. H.264 - integer transform
http://mrutyunjayahiremath.blogspot.tw/2010/10/frq-transformation-and-quantization.html
What are the advantages of integer transformation?

32. H.264 - deblocking

33. Arithmetic Coding Concept

34. H.264 - CABAC

35. H.264 - NAL (Network Abstract Layer)
http://gentlelogic.blogspot.tw/2011/11/exploring-h264-part-2-h264-bitstream.html

36. Comparisons

37. HEVC/H.265

38. HEVC - Frame Structure

39. HEVC - block mode
CU - Coding Unit
PU - Prediction Unit
TU - Transform Unit

40. HEVC - intra prediction

41. HEVC - ⅛-pixel inter prediction

42. HEVC - MV prediction

43. HEVC - SAO
http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6324411
The concept of SAO is to reduce mean sample distortion of a region by first classifying the region samples
into multiple categories with selected classifier, obtaining an offset for each category, and then addig the offset
to each sample of the category, where the classifier index and the offset of the region are coded in the
bitstream.

44. Miscs

45. Summary
▷ how to predict the frame
▷ extract temporal/spatial
redundant
▷ more and more fine-grained
▷ new ideas/tools

46. Development Workflow
H.264 JM: http://iphome.hhi.de/suehring/tml/
HEVC HM: http://hevc.hhi.fraunhofer.de/
Modified
Reference
Software
Proprietary
Implementation
Analyze
Tool
verification
data
golden
data
test cases
bitstreams

47. References
● An Overview of MPEG-2
http://literature.agilent.com/litweb/pdf/5966-1031E.pdf
● MPEG-4 natural video coding An overview
http://www.img.lx.it.pt/~fp/cav/Additional_material/MPEG4_video.pdf
● Overview of the H.264/AVC Video Coding Standard
http://654lab.webstarts.com/uploads/csvt_overview.pdf
● MPEG Video Compression Basics
http://www.springer.com/cda/content/document/cda_downloaddocument/9781441961839-c1.pdf
● http://www-i6.informatik.rwth-aachen.de/web/Misc/Coding/365/li/material/notes/Chap4/Chap4.3/Chap4.3.html
● H.264 and MPEG-4 Video Compression, Iain E. G. Richardson
● H.264 Specification
http://www.itu.int/rec/T-REC-H.264
● Overview of the High Efficiency Video Coding (HEVC) Standard
http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=6316136
● HEVC Specification
http://www.itu.int/rec/T-REC-H.265

48. “
Q & A
Thanks