Multimedia Analytics with 5G Edge Nodes

Innovations in Edge Computing and MEC

Sabidur Rahman

Telefonica internet para todos

Dean Bonehill ♠Technology for Business♠

Radisys at Mobile World Congress Americas

Radisys Corporation

Intel he rise-of-multi-access-edge-computing-paper

Edge computing: Cord build 17 telefonica use cases

Multi-access Edge Computing (MEC), Nokia

Saiful Hidayat Telkom Indonesia Vietnam Telecoms International Summit Nuturin...

Saiful Hidayat

Enabling the Future of Work with SD-WAN

Xylos

SDN, NFV and customer centric networks

Evolving Architectures for Small Cells in the Enterprise

Andy Odgers

D link corporate-presentation_apr. 2014

Kunal Raul

Small cell Evolution final

Xian Sun-Ilmonen

5G Evolution: VP Access Architecture and Device

In the past, we’ve seen a regular 10 year technology refresh with 2G, 3G and 4G each being added incrementally. Some believe that 5G will follow in the same cycle, although at the moment it remains vague and unpredictable. Others point out that the benefits of each new generation – mainly increasing spectral efficiency and releasing new spectrum – are reaching their full potential. This has been a key argument for small cell deployment, which increases capacity through frequency reuse without the need for additional spectrum or spectral efficiencies.

Fourth Dimension RAN white paper - ThinkSmallCell

Parallel Wireless, Inc.

Huawei: Extending MBB with HetNet and SON

Telefonica and open source

Ericsson’s Head of Product Area IP & Broadband (PAIB) Jan Häglund and Emerging Technology Manager for Fixed Network Technologies in Telstra's Chief Technology Office & Innovation group Frank Ruhl gave a joint presentation on service chaining before about 1,500 people Tuesday in the Santa Clara Convention Center’s main hall. Together, they showed Ericsson Service Provider SDN in action in a major operator setting, sending a message that the company has moved into the implementation phase of SDN for Tier 1 operator networks.

Cowen and Company 42nd Annual Technology, Media, & Telecom Conference

investormavenirsystems

Service Provider SDN Meets Operator Challenges

Ericsson Slides

What's hot (20)

Parallel Wireless Urban Coverage Solution Overview

Small cell 2020

Innovations in Edge Computing and MEC

Telefonica internet para todos

Radisys at Mobile World Congress Americas

Intel he rise-of-multi-access-edge-computing-paper

Edge computing: Cord build 17 telefonica use cases

Multi-access Edge Computing (MEC), Nokia

Saiful Hidayat Telkom Indonesia Vietnam Telecoms International Summit Nuturin...

Enabling the Future of Work with SD-WAN

SDN, NFV and customer centric networks

Evolving Architectures for Small Cells in the Enterprise

D link corporate-presentation_apr. 2014

Small cell Evolution final

5G Evolution: VP Access Architecture and Device

Fourth Dimension RAN white paper - ThinkSmallCell

Huawei: Extending MBB with HetNet and SON

Telefonica and open source

Cowen and Company 42nd Annual Technology, Media, & Telecom Conference

Service Provider SDN Meets Operator Challenges

Similar to Multimedia Analytics with 5G Edge Nodes

"Metaverse - The 'Killer App' for 5G, 6G and Beyond": With the growing popularity of X-Reality (VR/AR/MR/Metaverse) generation of global media-data is expected to accelerate at much higher rate and they will drive innovations and advancements in mobile networks. In this talk, challenges in Metaverse and we will explore suitable system architectures for streaming and analytics for Metaverse with the 5G edge nodes.

Metaverse - The 'Killer App' for 5G, 6G and Beyond

A talk from the XR Enablement Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Qualcomm: How to take advantage of XR over 5G in 2019: Understanding XR Viewers Prince Gupta | Qualcomm Hiren Bhinde | Qualcomm The opportunity for mobile XR is very strong and with 5G networks being deployed this year it will allow for more ubiquitous use of XR experiences and devices thus creating a bigger impact on society. Using XR viewers (AR or VR headworn connected to smartphones or other compute accessories through USB-C) allows for lighter and smaller designs while offering immersive and powerful computing and performance. There is already great ecosystem momentum for this new category of devices. In this session, learn about the use cases for XR viewers, the different form factors of XR viewers, architecture challenges, technology considerations and more. Learn how you can enable great XR experiences of 5G now. https://awexr.com

Qualcomm: How to take advantage of XR over 5G in 2019: Understanding XR Viewers

AugmentedWorldExpo

VR and AR are Pushing Connectivity Limits

A talk from the Inspire Track at AWE USA 2018 - the World's #1 XR Conference & Expo in Santa Clara, California May 30- June 1, 2018. Raheel Khalid (Envrmnt by Verizon): Cloud XR Experience on 5G with Mobile Edge Networks Augmented and Virtual Reality has a baseline for low latency and high-fidelity graphics which forces users into long install times and longer downloads. In this session, we will explore how Envrmnt built a pipeline for streaming 3d mesh data, textures, animations and more. We'll review our platform for delivery, distribution and real-time updates that scales to hundreds of thousands of concurrent users and is accelerated by 5G and Verizon's Mobile Edge Cloud Computing Platform. http://AugmentedWorldExpo.com

Raheel Khalid (Envrmnt by Verizon): Cloud XR Experience on 5G with Mobile Edg...

AugmentedWorldExpo

A talk from the Enterprise Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Brian Vogelsang (Qualcomm): 5G and the Augmented Enterprise 5G promises to bring new levels of performance and efficiency that will power new user experiences and redefine a broad range of industries with connected services from retail to education, transportation to entertainment, and everything in between. 5G will also be a catalyst for Augmented Reality in the Enterprise, delivering multi-Gbps peak rates, ultra-low latency, massive capacity, and a more uniform user experience to businesses deploying AR technology. With 2019 as the beginning of a new era in communications, come learn how 5G will intersect the Enterprise Augmented Reality glasses of today, and become a fabric for enabling the more immersive experiences of tomorrow. https://awexr.com

Brian Vogelsang (Qualcomm): 5G and the Augmented Enterprise

AugmentedWorldExpo

Extended reality (XR)—which includes AR, VR, and everything in between—is already providing revolutionary experiences today. Taking XR to the next level of immersion within the power and thermal constraints of a sleek mobile device is a critical challenge. What if we combine the power-efficient, latency-sensitive on-device rendering and tracking of the XR headset with the partial rendering capabilities of the edge cloud over a low-latency 5G link? We get boundless mobile XR experiences with photorealistic visuals. Making this vision a reality will require the entire XR and 5G ecosystem coming together.

Boundless Photorealistic Mobile XR Over 5G

As the industry strives toward immersive VR experiences, we are guided by the extreme requirements associated with intuitive interactions, visual quality, and sound quality, in order to achieve the ultimate mobile VR experience. Precise, low-latency motion tracking of head movements is crucial for intuitive interactions with the virtual world, and visual-inertial odometry (VIO) is the ideal complementary subsystem to achieve this goal. VIO allows for six-degrees of freedom (6 DoF) in VR experiences, reduces latency, and cuts the cord. In this presentation, you will learn about: • The enhanced user experiences that 6 DoF provides over 3 DoF • The evolution of motion tracking • How Qualcomm’s on-device VIO implementation provides a precise head pose at a high frequency yet at low latency and power • The impact of 6 DoF on VR content development

On-device Motion Tracking for Immersive VR

Qualcomm Developer Network

How to take advantage of XR over 5G: Understanding XR Viewers

The Virtual Reality (VR) is considered by industrials from content industry as a major technology to develop in the next years. It comes however with a number of challenges, which will require the cooperation between multiple actors in the content delivery chain. Since it combines high quality multimedia delivery and low-latency interactivity, VR matches the requirements of 5G networks and it has the potential to be a key driver for adoption of the next generation network. In this talk, the main requirements of the envisioned next-generation VR applications will be reviewed, especially the need of both bandwidth and latency. Then, the main delivery architectures will be presented, including their main weaknesses in today’s networks and the efforts that are currently done in standardization groups to provide the main elements of these architectures in the perspective of 5G. Finally, a selection of the main open challenges will conclude the talk.

Virtual Reality in 5G Networks

Gwendal Simon

Extended reality (XR) is already providing revolutionary experiences today, and it’s important for developers to know all the latest advances. Taking your XR development to the next level of immersion within the power and thermal constraints of a mobile device is a critical challenge. A new era in distributed computing powered by 5G, on-device processing, and edge cloud processing could offer a solution. What if we combine the power-efficient, latency-sensitive on-device rendering and tracking of the XR headset with the partial rendering capabilities of the edge cloud over a 5G link with low latency and high quality-of-service? We get boundless mobile XR experiences with photorealistic visuals. Making this vision a reality for developers will require the entire XR and 5G ecosystem coming together.

More Immersive XR through Split-Rendering

Qualcomm Developer Network

ABI Research White Paper: Augmented and Virtual Reality: The First Wave of 5G...

This video and the corresponding presentation looks at the definition of Extended Reality, XR and how 3GPP 5G standards are evolving to cater for XR in the future releases. XR is an umbrella term for all the immersive technologies. The ones we already have today are Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR) plus those that are yet to be created. All immersive technologies extend the reality we experience by either blending the Real and/or Virtual Worlds or by creating a fully immersive experience. The video for this presentation is available here: https://www.youtube.com/watch?v=nDAmK3jhCuQ All our #3G4G5G slides and videos are available at: Videos: https://www.youtube.com/3G4G5G Slides: https://www.slideshare.net/3G4GLtd 5G Page: https://www.3g4g.co.uk/5G/ Free Training Videos: https://www.3g4g.co.uk/Training/

Enabling Mobile Virtual Reality Gaming | Nizar Romdan

Jessica Tams

Nizar Romdhane, ARM

White Nights Conference

Intermediate: 5G and Extended Reality (XR)

3G4G

Mobile Extended Reality (XR) is likely to become one of the world’s most disruptive computing platforms. It is expected to transform the way we interact with the world around us every day, delivering unprecedented new experiences and the potential to exponentially increase productivity. XR is inherently meant to be mobile, intuitive and always connected. Many new technologies in the areas of low power visual processing, cognition, and connectivity are required for this vision to become reality. This presentation discusses: • A view of the evolution of XR from today to the future • Examples of unprecedented experiences that XR is expected to enable • Necessary technology advancements required in areas such as 3D graphics, computer vision, next-gen displays, machine learning, and wireless connectivity to support a new class of intelligent, and personalized XR experiences https://www.qualcomm.com/invention/extended-reality

The Mobile Future of Extended Reality

It’s highly likely that VR and 360° video will soon find their way in our daily life, in context of gaming, entertainment and virtual workspaces. All these applications share one big difficulty – the need do get huge amounts of data to display the video. To solve this challenge and ensure highest video quality, with minimal startup time and no buffering, adaptive streaming technologies like MPEG-DASH and Web standards like HTML5 are a perfect fit, and enable seamless streaming of VR and 360° content.

Web-based Adaptive VR and 360° Video Streaming

Reinhard Grandl

Harvard presentation

Jonathan Brill

The media landscape changes significantly over the last few years by new content formats, new service offerings, additional consumption devices and new monetization models. Think of Netflix, DAZN, Mediatheks, mobile devices, interactive content, smart TVs, Virtual and Augmented Reality, and so on. Many of these efforts have been realized by a limited usage of standards, but are standards irrelevant? Secondly, more and more services are enabled by latest mobile compute platforms enabling new services and experiences. This presentation will provide an overview some of these trends and will motivate the development of global interop standards. Specific aspects will include the move of linear TV services to the Internet (both mobile and fixed) as well recent advances on Extended Reality and immersive media trends.

New Media Services from a Mobile Chipset Vendor and Standardization Perspective

Förderverein Technische Fakultät

MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...

MIPI Alliance

UplinQ - qualcomm® snapdragon™ processors a super gaming platform

Satya Harish

Similar to Multimedia Analytics with 5G Edge Nodes (20)

Metaverse - The 'Killer App' for 5G, 6G and Beyond

Qualcomm: How to take advantage of XR over 5G in 2019: Understanding XR Viewers

VR and AR are Pushing Connectivity Limits

Raheel Khalid (Envrmnt by Verizon): Cloud XR Experience on 5G with Mobile Edg...

Brian Vogelsang (Qualcomm): 5G and the Augmented Enterprise

Boundless Photorealistic Mobile XR Over 5G

On-device Motion Tracking for Immersive VR

How to take advantage of XR over 5G: Understanding XR Viewers

Virtual Reality in 5G Networks

More Immersive XR through Split-Rendering

ABI Research White Paper: Augmented and Virtual Reality: The First Wave of 5G...

Enabling Mobile Virtual Reality Gaming | Nizar Romdan

Nizar Romdhane, ARM

Intermediate: 5G and Extended Reality (XR)

The Mobile Future of Extended Reality

Web-based Adaptive VR and 360° Video Streaming

Harvard presentation

New Media Services from a Mobile Chipset Vendor and Standardization Perspective

MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...

UplinQ - qualcomm® snapdragon™ processors a super gaming platform

More from Anand Bhojan

Emerged as a choice of display for vivid colours and power efficiency in expensive Smartphones, in recent days Organic Light Emitting Diode (OLED) displays are increasingly replacing Liquid Crystal Displays (LCD) and Plasma in Smartphones and large screen Televisions. Yet, OLED displays are one of the most energy consuming modules in modern Smartphones. Power consumption of OLED displays have strong correlation with the colours illuminated by its pixels. Improvements in pixel density by manufacturers makes the displays more power hungry. In this paper, we present Human Visual System (HVS) aware adaptive colour transformation and darkening methods to create power-efficient videos for OLED displays while preserving visual fidelity of the videos. Our measurements and subjective evaluations show that we can save up to 60% of energy consumption with minimum distortion to visual quality of the video. As our colour transformation process uses pre-computed colour-map and the darkening process uses the gamma-correction function which is already implemented in most of the display hardware, runtime computation overheads are minimum and hence, our method can be used to manipulate realtime/live video streams as well.

Adaptive Video Content Manipulation for OLED Display Power Management

[This is a short introduction pitch to the full paper.] Though there is an explosion of cloud services in recent years, cloud gaming industry is still way behind in making a strong breakthrough. Despite many benefits of cloud gaming (video or pixel streaming of rendered game scenes), the primary factor that hinders the growth is "response latency", a well known issue. In this paper, we introduce a novel predictive paradigm of cloud gaming in order to mitigate latency that is inherent in cloud gaming systems. The main idea of the predictive paradigm is to pre-generate and send future outcome frames in advance to the thin-client so that the thin-client can respond immediately to any user input. The approach in this work seeks to exploit the near unlimited processing power of the cloud and ever increasing network bandwidth. The paper provides a generic and comprehensive theoretical model that shows the relationship between various parameters (network bandwidth, round-trip-time and processing time for game logic, predicting future outcomes, rendering, capturing, encoding and decoding) of predictive cloud gaming and response latency. The theocratical model design is started with an ideal server with unlimited resources for ease of understanding and then it is enhanced with resource constraints of a practically feasible non-ideal server. The model demonstrates significant amount of response latency reduction in predictive cloud gaming when compared to conventional cloud gaming. The model is analysed further to estimate the resource requirements for predictive cloud gaming. A simple game is built to demonstrate key aspects of the model and to conduct subjective evaluation of quality of experience (QoE) of the game play. The evaluations show significant gain in QoE. The resource requirements of the predictive cloud gaming gaming system grows exponentially with respect to prediction period of future frames. The paper illustrates some optimisation methods to reduce exponential growth and discusses directions for further works in this area.

CloudHide: Towards Latency Hiding Techniques for Thin-client Cloud Gaming

This technical demonstration presents the SuperStreamer project, which enables progressive game assets streaming to players while games are played, reducing the startup time required to download and start playing a cloud-based game. SuperStreamer modifies a popular game engine, Unreal Engine 4, to support developing and playing games with progressive game asset streaming. With SuperStreamer, developers can mark the minimal set of files, containing only the game content essential to start playing the game. When a player plays the game, these minimal set of files will be downloaded to the player's device. SuperStreamer also generates low resolution textures automatically when a developer publishes a game, and these low resolution textures are transmitted first into the game client. As players move through a game level, high quality textures required for the game will be downloaded. In our demo game, we are able to decrease the time taken to startup and load the first game level by around 30%.

SuperStreamer: Enabling Progressive Content Streaming in a Game Engine

To adapt game difficulty upon game character’s strength, Dynamic Difficulty Adjustment (DDA) and some other learning strategies have been applied in commercial game designs. However, most of the existing approaches could not ensure diversity in results, and rarely attempted to coordinate content generation and behaviour control together. This paper suggests a solution that is based on multi-level swarm model and ecosystem mechanism, in order to provide a more flexible way of game balance control.

Game balancing with ecosystem mechanism

Game Balancing with Ecosystem Mechanism

Would it be possible to bring the promise of unlimited re-playability typically reserved for Roguelike games to competitive multiplayer shooters? This paper tries to address this issue by proposing a novel method to dynamically generate maps at run-time almost as soon as players press the Play button, while ensuring the features what players would expect from the genre. The procedures are simple and practically feasible to be employed in actual computer games. In addition, the work experiments the possibility of incorporating asynchronous game-play element into a multiplayer shooter with human imitating bots where the players can let their bot/avatar replace them when they are not around. The algorithms are implemented and evaluated with a playable game. The evaluations prove that playable 3D dynamic mapscan be generated in order of seconds using game context data to initialise the parameters of the algorithm. The paper also shows that asynchronous game-play element is a possible feature for consideration in next generation multiplayer shooters.

TIṬAL – Asynchronous multiplayer shooter with procedurally generated maps

Large-scale Media Processing on Cloud - Cloud Asia 2016 PANEL DISCUSSION

Robotics is an extremely dynamic field with thriving advancement in its technology. As research progresses in robotic systems, more and more aspects of vision based processing, GPS enabled services, Autonomous techniques, very far distance communication in robots, dynamic environment handling, mobility techniques, multi-agent control and coordination techniques, multi-robot communication and coordination are explored to make robotics intelligent and to do specific tasks. Vision has helped in many areas for better services and fastens the process for localized results. Advancements in communication, positioning and localization techniques brought the robotics beyond the controlled industrial environments to more dynamic outdoor environments. Research in autonomous and other intelligent techniques has made robots capable of taking decisions in complex environments. The book covers future trends in robotics research topics including motion path planning, routing in dynamic environments, multi-agent control techniques, nature inspired algorithms and synchronization techniques with interesting applications.

Introduction to the Special issue on ‘‘Future trends in robotics and autonomo...

ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...

The use of recording applications for teaching is increasingly popular, with tools such as Ink2Go and ShowMe being available on many platforms and at reasonable cost. However, most recording applications available are typically native applications and do not work within the web browser. In this work, we study the feasibility of implementing a recording solution in the web browser environment. The design details of ShowNTell can be found in the paper (http://www.comp.nus.edu.sg/~bhojan/papers/ShowNTell15.pdf) published in IEEE ASEE 45th Frontiers In Education 2015 Conference. Please use it for all the references of this ShowNTell project. Poster: http://www.comp.nus.edu.sg/~bhojan/papers/showNtell15.png Details and Demo @ www.sntboard.com NB:- There are new features such as real-time collaborative drawing and non-linear editing are added in the latest versions. Register at www.sntboard.com to get regular updates. "The greatest challenge of education in the digital world is to train the mind to focus with a strong feeling of purpose where the time shrinks and to re-focus at will" - Dr Bhojan Anand

ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...

This work explores the possibility of transferring data between mobile devices that are nearby each other without the need of pairing, authentication, superuser access and Internet connectivity. Such technology can be used for emergency broadcast, traffic congestion avoidance, IoT, smart city, social and dating systems and games. Except Bluetooth Low Energy technology, there is no other protocol or technology available that allows pairing-free data transfer without Internet connectivity. Bluetooth Low Energy is capable of doing so but at a relatively short range. Using Wi-Fi Direct's Service Broadcast and Discovery, a simple yet novel method is developed which allows for seamless long range (Wi-Fi range) data transfer without Internet connectivity. The design details of FATS-mumble can be found in the paper (http://www.comp.nus.edu.sg/~bhojan/papers/mumble15.pdf) published in ACM Mobicom 2015 SmartObjects. Please use it for all the references of this mumble project. The project is open sourced (Github Link): https://github.com/FatsGW/FATS-Mumble. Demo: http://youtu.be/ACmNYLd2NlI

mumble: Framework for Seamless Message Transfer on Smartphones

mumble: Framework for Seamless Message Transfer on Smartphones

With the advent of feature rich smartphone platforms such as Android and iOS, people can now enjoy a wide variety of applications on-the-go. Among these applications, games are one of the most desired types. However, as bigger screens, faster CPUs and interfaces supporting higher bandwidth (WiFi, 3G, LTE) consume more power, battery lifetime becomes a bottleneck on such devices. In this paper, we present novel techniques that combine 3D spatial subdivisioning, Potentially Visible Set (PVS) and Visual Perception based Localisation (VPL) methods to estimate the non-critical game states to save wireless interface energy with minimum processing penalty. Our techniques and algorithms are realised in a commercial game and can save up to 57% of wireless interface energy while retaining game play quality.

Energy Efficient Multi-player Smartphone Gaming using 3D Spatial Subdivisioni...

ARENA - Dynamic Run-time Map Generation for Multiplayer Shooters [Full Text]

Displays are one of the major system energy consumers in smartphones. Power consumption of Organic Light-Emitting Diode (OLED) displays have direct relationship with the colour and intensity of the contents being displayed. Games are one of the most popular smartphone applications that consume relatively more resources and power. In this paper, we present Human Visual System (HVS) aware algorithms and techniques to reduce OLED display power consumption up to 45% while retaining the perceived quality of game content. We have implemented and evaluated our solution in the game Quake III and its Android port Kwaak3.

PARVAI - HVS Aware Adaptive Display Power Management for Mobile Games [Full T...

Gamelets - Multiplayer Mobile Games with Distributed Micro-Clouds [Full Text]

Energy Efficient Mobile Applications with Mobile Cloud Computing ( MCC )

ARENA - Dynamic Run-time Map Generation for Multiplayer Shooters

PARVAI - HVS Aware Adaptive Display Power Management for Mobile Games

In recent years, cloud computing services have been increasing in greater pace. High penetration rate of mobile devices and resource limited devices escalate the demand for cloud services further. Even though the cloud industry continues to grow exponentially, the cloud gaming service has been left behind due to the limitations in today's technology. There are three well known reasons for the slower growth - latency, server scalability (esp. bandwidth) and lack of game data at client side to use latency hiding and synchronisation techniques such as Dead-reckoning. In this paper, we propose a novel distributed micro-cloud infrastructure with a next generation device called Gamelet to mitigate the limitations in traditional cloud system for multiplayer cloud gaming on resource limited mobile devices. The paper also investigates the opportunities, issues and possible solutions for Gamelet infrastructure for mobile games with a demonstrable prototype.

Mobile Cloud Computing for Games - Gamelet