ott.ua.edu

1. (UAIPD #13-0020) Prioritized, high quality H.264 video transmission
over wireless channels through cross-layer forward error correction
scheme with Raptor and RCPC codes
Inventors: Fei Hu, Yeqing Wu, Sunil Kumar
May 6, 2013

2. What is this invention?
• Significantly improve the real-time video quality
over unreliable, erroneous, wireless
communication links;
• We are the first group to integrate (1) Raptor
Codes, (2) Cross-layer design, and (3)
Wireless, prioritized, multi-channel
transmissions.
• This research is sponsored by DoD
(Department of Defense)

3. History
• Companies (such as Netflix, Comcast) needs to
deliver high-quality video to Wi-Fi or any mobile
devices (such as iPAD, cell phone, laptop, etc.)
• However, existing H.264 video has low quality
(such as jitter, delay, color distortion, etc.) under
poor wireless links
• How do we guarantee high-resolution video
services over poor wireless links?

4. Our Technology
• Cross layered forward error correction scheme
to increase video quality of wireless
connections
• Combines new raptor code with rate
compatible punctured convolution
• Unequal error protection at application layer
and physical layer
• Funded by DoD (total 3 grants!)

5. We are the first group to integrate
4 components into one network!
(Multi-channel transmission)

6. Sub-Innovation 1: UEP Raptor Codes
in Application layer

7. Sub-Innovation 2: UEP RCPC
Codes (in Physical Layer)
• For four priority groups of AL-frames, we have
R1<=R2<=R3<=R4

8. Sub-Innovation 3: Cross-Layer UEP
FEC
• Application layer and Physical layer share the same available channel
bandwidth.
• For poor wireless link, conventional schemes assign a higher portion
of the available redundancy to Raptor codes at AL. This may not
improve the delivered video quality since almost all PHY-frames would
be corrupted during transmission.
• We have found out that the RCPC code rate at PHY can be increased,
and more channel bandwidth becomes available for Raptor coding at
AL.
Goal:
• Cross-layer optimization between AL FEC and PHY FEC to deliver a
video with the highest possible PSNR for a given channel bandwidth
C and SNR.

9. Better than conventional schemes!
Our invention:
Integrate
raptor codes,
cross-layer
design,
prioritized
transmission
and multi-
channel ideas!
Conventional
scheme 1:
without
using Raptor
codes
Conventional
scheme 2:
without
using cross-
layer design
Conventional
scheme 3:
without
using
Prioritized
transmission

10. Very promising applications!
• Prioritized, wireless, multimedia Transmission (VOD, Video
conference, Online Movie, especially for wireless)
• High Priority Video data
– Sequence Parameter Set
– Picture Parameter Set
– I/IDR Frame
– Base Layer (H.264/SVC)
• Low Priority Video data
– B Frame
– Enhance layer (H.264/SVC)

11. Application example 1
High-quality
movie delivery!

12. Application Example 2 -
Teleconferencing

13. Application example 3 –
Prioritized Video Transmission
• Prioritized Medical Image transmission
• High Priority Image data:
– Region of Interest (RoI) that doctors care about. Like
• Low Priority Image data:
– Background

14. Application example 4: Remote
Patient Monitoring (using cameras)
6/27/2016 by Fei Hu 14
• Fei Hu, "Functional Near-Infrared (fNIR) Spectroscopy for Auto-Rehabilitation Cyber-Physical Systems:
Towards Intelligent Signal Processing for Training Progress Indication," Cyber-Physical Systems:
Integrated Computing and Engineering Design, Publisher: Taylor & Francis LLC, CRC Press, to appear in
May 2013.
• F. Hu, Chad Buckallew, Sarah Duncan, et. al., "Augmented Cognition for Intelligent Rehabilitation,"
(accepted) Cyber-Physical Systems: Integrated Computing and Engineering Design, Publisher: Taylor &
Francis LLC, CRC Press, to appear in May 2013.

15. Market
• Wireless Video Transmission Technology (2010)
• CAGR: 105.1%
• 11.8 million global units sold
• 28 million including smart phones
• 241.1 million units in 2015
• Growing Market
• High demand for wireless video devices

16. Market Cont’d - teleconferencing
• Teleconferencing Service Providers (such as
InterCall, Inc.)
• $61.4 million annual sales
• 54% of employees use videoconferencing in
businesses with over 100 employees.
http://www.informationweek.com/smb/network/executives-demand-communications-
arsenal/227501053

17. Potential Customers
• Video conferencing companies
• Internet TV (IPTV) companies (such as Comcast,
AT&T, QUALCOMM, etc.)
• Netflix, Vidyo Inc., InterCall Inc., Qumu Inc.,
Video Commnications Corp, LifeSize Inc., Cisco
• Wireless Video Transmission Technology
Manufacturers
• Hewlett-Packard, Galaxy Microsystems Ltd.,
Vizio, Silicon Image

18. Literature Search

19. Patent Search
USPTO.gov
Search Terms
Term 1 Term 2 Term 3 Number of Hits Relevant Hits
Raptor Code 325n/a
unequal error protection 2724n/a
UEP FEC 61
UEP video transmission 138n/a
UEP multi-layer 3n/a
raptor multi-layer 9
FEC raptor 71n/a
FEC raptor multi-layer 0n/a
raptor cross-layer 2n/a
Relecura
(UEP)* multi-layer wireless channel n/a
(UEP)* multi-layer wireless channel
wireless
communication 2