High Definition (HD) video is becoming more and more popular in broadcasting, streaming and video communications. We see HD enabled TVs, screens and communication equipment more widely deployed but still we don’t see too much HD Video Communication deployed in the desktop level and to the masses.
Why is that still the case? From a technological standpoint, the world is ready for HD. Processors are optimized to support it, video codecs are available and HD displays are common in the market. Still, the complexity and cost of building HD video solutions are very high. The migration of a Standard Definition (SD) product to HD requires a complete redesign of the solution, including processors, codec optimization, HW design, HD cameras and handling of video quality issues including higher packet loss due to bandwidth utilization. The overall cost of such a task may add-up to tens of millions of dollars.
Radvision, however has a solution that will help you, cost effectively, develop, HD video solutions. By attending this webinar, you will learn:
* What are the challenges in building HD video communication solutions
* How to handle video quality issues by using SVC and FEC
* How can RADVISION BEEHD video client framework help you develop cost effective HD interactive video communication products
* What is included in the RADVISION BEEHD Framework
Who should attend:
* Developers, architects
* Product Managers
* CTOs, VP R&D
* Marketing executives
* Segments - TV's, STB, LCD, Projectors, MID, Digital Picture Frames, Netbooks manufactures and any other device that includes a screen and can present Video
3. Agenda RADVISION Overview Interactive Video Moving to HD Video Hardware Architecture BEEHD Case Study
4. Welcome to RADVISIONTHE INDUSTRY’S EXPERT IN VISUAL COMMUNICATIONS RADVISION is the leading provider of core technologies, products and solutions that enable unified multimedia communications over IP, 3G and emerging next generation IMS networks.
5. RADVISIONPowering Voice and Video Communications Leader Since 1992 Over 450employees worldwide Global presence with17offices worldwide Revenue of $85m in 2008(NASDAQ:RVSN) Cash reserves: $120m and debt free
6. RADVISION Industry Leadership Technology BU Enabling technology for developers of V2oIP, 3G andIMS Client and Server solutions Powering V2oIP deployment across the globe Testing suite with unique video quality validation offering Turnkey solutions from Global Services Group – experts in V2oIP
7. Our Mission To be the first choice for developers of IP voice and video communications solutions with innovative, high quality products and services
8. Solutions Portfolio Turnkey Solutions Professional Services Testing & Validation Client Solutions SIP Server Solutions SIP Server Core B2BAF Presence & Events Protocol Toolkits NAT Traversal MSRP A-RTP Diameter RTSP SIP Suite MEGACO MGCP 3G-324M H.323
10. What is “Interactive Video”? Bi-directional, real-time video sessions – people communicating with people Two or more endpoints/particpants High quality video - up to HD over unmanaged network conditions IP (SIP/IMS) or 3G (3GVT)-based video Video capabilities embedded in any consumer electronic or enterprise device (e.g. Netbooks, Smartbooks, STBs, PMP, DPF…)
11. Video Messengers Video Conferencing and TelePresence Systems Social Network Sites Growing 50% Year-on-Year Connected TV Growing Demand for Distance Learning Video-enhanced kiosks Interactive Video is Everywhere! Video Conferencing ASPs
12. Technology and Devices are Video-Ready Processors & CPUs are cost effective and HD video capable Video codecs and quality algorithms available supporting HD Increasing number of devices that are video ready Interactive video ready Netbooks/Smartbooks are gaining popularity Built-in WiFi (a/b/g/n), 3G (HSPA), Webcam, Bluetooth
13. Cross Segment Video Communications Demand Enterprise: The largest enterprise players are offering video CISCO, IBM, ALU, HP Internet: Growing use of PC-based interactive communications Skype, Yahoo, Google talk, WebEx Living Room Appliances are becoming the center of family communications and entertainment Communications-enabled, PC-like gaming systems Interactive TV with Internet-enabled browsing Video communications-enabled TV “Skype TV”
17. What Makes Interactive Video Complex? It is a real-time service real time encode/decode processing Delay-sensitive less than 400msec end to end Public network Limited bandwidth Unmanaged networks (e.g. Internet) packet loss High Definition Complicating all the above… High Definition
18. The Transition from SD to HD is Complex Complexity in multiple areas: HW SW – media codecs, application, signaling Interoperability Bandwidth management Quality
24. 24 Hardware Design (Dual Chip Solution) AIC23 SPK TI DM6467 - Decoder DM 647 (OSD) Ethernet Decoded Video Flash EMIF Display EMIF USB (TUSB6010B) USB GPIO Control & OSD HPI BT1120 or Raw RGB TI DM6467 - Encoder HD Camera Self View Flash EMIF AIC23 MIC AEC
25. Hardware Design (Single Chip Solution) DM6467 Encoder/Decoder AIC23 Ethernet SPK BT1120 or Raw RGB HD Camera Video Port AIC23 MIC AEC PCI GPIO DM6437 Video Render/ MJPEG Decode OSD 600MHz Display
26.
27. BEEHD Overview client is the industry’s first complete and cost effective solution for adding high quality interactive video communication to embedded devices
29. SW Architecture HD Camera Display Display Input Speakers Microphone Network
30. BEEHD Solution - Technical Specifications Video Codec: H.264 Video resolutions: QCIF up to 720p @30fps Video Quality algorithms Bandwidth: ~1Mbps Audio Codecs: G.711, G.729, G.722, G722.1 Multiple standards: SIP and H.323 Interoperability with leading vendors
31. Value Proposition Minimize time-to-market Superior media quality Interoperability across multiple platforms Designed and optimized for embedded systems
33. Requirements for HD Video Mass Deployment Cost effective solution Fully integrated (software and hardware) Interoperable High QoE over unmanaged networks (public Internet)
34. VC240 Built jointly by Samsung and RADVISION powered BEEHD technology Integrated: Camera Speakers Microphone Remote control External audio accessories SIP/H.323 Launch: September 2009 34
35. Q&A Developer Community Learn more about BEEHD and join our developer community BEEHDhttp://www.radvision.com/Products/Developer/BEE/BEEHD/default.htm SVC http://www.radvision.com/svc/ developer.radvision.com Newsletter Blogs realizeVoIP.radvision.com blog.radvision.com
So what makes the interactive video especially for HD so complicated- Real time service requires real time voice and video processing include encoder, decoder pre/post processingDelay Sensitive –interactive end to end video communication should be less that 400msec and also make sure that audio and video are synchronized (Lip-sync) Public Network – different users uses different connection type and the interactive video should pass through all even when there is limited bandwidth Unmanaged Network - one of the major challenges is to be able to overcome the packet loss over unmanaged network like the internetHigh Definition – The High definition actually complicated all the above and make it even a bigger challenge
HW – Requires changes in the HW silicon and platform to support high definition. Most cases to redesign of the HWSW –Media codecs encoder and decoder are become more complex and theiroptimization requires more work in order to fit the same network condition , application and signaling need to be modified as well to fit the new codecs and configuration items. Interoperability – requires verify the interoperability with both HD and SD devicesBandwidth management – optimization of the compressed data and allow communicate more information with the same network bandwidthQuality – in order to maintain high definition quality for video and audio, some quality algorithms required in order handle and protect the video and audio over live unmanaged network
Developing an interactive video solution requires 4 main building blocksHW platform and OS in order to be able to run an process a complete solution with application, signaling and media there is a need for the right platform that can handle the complete application and to choose the operating system that fits the best to your solutionSignaling protocols and call control – this block is required in order to communicate between 2 entities and maintain the connection until the end of the call , this block is also handling all the IP communicationThe media & codecshandles all the video and audio processing include the quality algorithms to allow up to high definition qualityThe application is in the highest level that handles the interaction with the user and allow controlling all the interactive video communication scenariosIn general and interactive solution should include the following peripherals: HD Camera, Microphone, Display input if you are using another input device like screen or pc, Display output to present the application and the video, Speakers for the audio and the network connection
One of the challenges in building high definition interactive video device is to be able to maintain high quality video when running on unmanaged network like the internetThe major problem is packet loss that effect the quality of the video and in the end the quality of experience of the userThe following graph present the difference between normal H.264 behavior (colored in the blue) to a H.264 that include SVC (Scalable Video Coding) – Error Resiliency algorithm on unmanaged network, this graph will present the results of these codecs for both 5% and 20% packet loss
As you can see at 5% packet loss the quality of the outcome video for normal H.264 is bad as many frames cannot be processing when 5% of the packets are loss and the decoder cannot handle these frames. with the same missing packets for H.264 with SVC the quality is maintained although it does effect the picture but as you can see the difference in the quality and how the SVC help maintain the quality even in 5% packet loss
This Example present 20% packet loss and as you can see the normal H.264 codec cannot handle this picture and you can barley recognize the woman in the picture compare to the H.264 codec with SVC the quality still maintain, of course some other parameters are effected like the frame rate but we all agree that quality is the most important for user experience
We discuss on the challenges in developing interactive video with HD capabilities and also discussed on the Software and quality issues. Now let’s take an example of an hardware that need to be use in order to build high definition interactive video communication device
This example present dual chip solution based on TI Davinchi chip and as you can see there is one chip that handle the Encoders (both Video and Audio) . The necessary hardware peripherals like the camera and the microphone are connected to this chip The second chip handle the Decoders (Video and Audio) as well as the application and the network connection this is a master chip that control the other chipThe connection between the chips is using USB and only compress data (Video and Audio) is passing on this lineThere is another chip call DM647 that handles all the Video layouts and the OSD (On Screen Display) and the output to the screen itself.
The single chip solution can handle everything on one chip and in this example will use the DM6467 1Ghz chip that capable to process both encoding and decoding on the same chip with 720p@30fpsThe second chip is DM6437 which is used for the OSD and the video layouts
Let’s summaries what we have discuss up to now. We seen the complexity of the video in general and the complexity of moving from standard definition to high definition video. We also discuss on the growing trend and openness of people to use video on one hand and the growing requirements from the enterprise and consumer on the other. Giving this RADVISION introduced a new high definition client framework that allows companies to easily migrate to high definition video in a significantly lower effort. The name of the product is BEEHD
The function design present three main blocks The signaling and Media engine – that will handle all the communication protocols and the media processingInteractive VOIP client – this is the application layer that responsible for the complete integration of the signaling and the media and expose high level simple API for the integration of the customer GUI/OSDThe video Quality is responsible to maintain the high definition quality during a callAs you can see the BEEHD provide the complete solution for customers and allow easy integration for the customer GUI and Hardware
The Software architecture is divided to 4 main parts: The Hardware platform and OS –required to fit the interactive HD solution ,The Hardware platform should be capable of processing HD video (both Encoder and Decoder) and run the application network communication in parallel to the media processingThe signaling is painted in green and include signaling protocols like SIP, H.323 and ARTP to handle the media transport. The call control is handling all the call related issues, the common core layer is RADVISION OS abstraction layer that allow all RADVISION products to be able to run on different operating system without a need to change anything on the product itself rather just replace the common core layer with the suitable operating system support. The orange part present the media handling, the codecs are already integrated and optimized for the HW platforms (for example the TI Davinchi) and the media engine take care of all the media related issues from initialization, configuration and create media flow during a call)The HD client layer (also in Orange) is responsible for the integration of the Signaling and media on one hand and to expose a very simple API’s for the customer/developer on the other , for easy integration of customer OSD/GUI
This slides summaries the BEEHD technical specification
The value proposition for the BEEHD Starting from Minimized time to market, using RADVISION BEEHD make it easier to add HD interactive video communication to your device and save much development and integration time. Superior media quality as the quality of experience of the user is most importantInteroperability across multiple platforms – allow wide adoption of your product with guaranty that you will be able to connect with all the other different endpoints that are available today in the marketDesigned and Optimized for Embedded system – this allow customer to choose a complete solution that includes pre-integrated and optimized embedded HW in order to build an interactive video product
These are some requirements in order to build HD video for the Mass deployment for example the VC240