SlideShare uma empresa Scribd logo
1 de 17
Baixar para ler offline
Docker-Based Evaluation Framework for
Video Streaming QoE in Broadband Networks
Cise Midoglu1
, Anatoliy Zabrovskiy2
, Özgü Alay3
, Daniel Hölbling-Inzko4
, Carsten
Griwodz5
, Christian Timmerer2,4
1
Simula Research Laboratory, 2
University of Klagenfurt, 3
Simula Metropolitan Center for Digital
Engineering, 4
Bitmovin Inc, 5
University of Oslo
OS-05
Motivation
● Video streaming one of the top traffic contributors in the Internet
● Mobile broadband (MBB) networks becoming more and more prominent
● Metadata-rich measurement result
collection is challenging
● Over-the-top (OTT) video analytics
are not used widely in research
OS-05 2
Overview
● Automatised measurement and evaluation framework for video streaming
Quality of Experience (QoE)
OS-05 3
Overview
● Automatised measurement and evaluation framework for video streaming
Quality of Experience (QoE)
○ End-to-end with client and server side
○ Client-initiated active measurements
○ Docker virtualization → platform compatibility
○ Headless streaming → focus on objective QoE
○ Allows to monitor and collect data from multiple layers (application, transport,
network, physical)
○ Allows to benchmark video players, ABR algorithms, networks, operators, ...
OS-05 4
Client Side
● Designed to emulate real user initiating
a video streaming session
● Selenium instrumentation opens
headless browser and streams from
HTTP server
● Implemented as Docker container
● Compatible with mobile broadband
testbeds (e.g., MONROE)
● Configurable (network, player, ABR
algorithm, run duration, batch
experimentation, ...)
● Additional network monitoring (ping +
traceroute), and metadata if available
OS-05 5
Server Side
OS-05 6
● Server hosts landing pages with 3
different video players
○ Bitmovin Player v8
○ Shaka Player v2.5
○ DASH.js Player v2.9
Server Side
OS-05 7
● All test pages use the same asset
○ BigBuckBunny video
○ Encoded in 15 qualities (100 Kbps to
15 Mbps)
○ Retrieved from CDN
Server Side
OS-05 8
● All test pages are integrated with
Bitmovin Analytics web collector v2.3
○ JavaScript executed on client browser
in runtime
Server Side
OS-05 9
● All pages are integrated with Bitmovin
Analytics web collector v2.3
○ More than 70 parameters recorded for
each session (including startup time,
video quality, num. switches, stalls, ...)
Server Side
OS-05 10
● All pages are integrated with Bitmovin
Analytics web collector v2.3
○ Possible to view metrics in real-time
from the Bitmovin Dashboard, or export
in raw format using the Bitmovin
Analytics Export Service
MONROE Integration
OS-05 11
MONROE Integration
OS-05 12
MONROE Integration
OS-05 13
Use Cases and Intended Audience
OS-05 14
Demo
OS-05 15
16
• Two grand challenges
– Improving open-source HEVC encoding
– Low-latency live streaming
• Focus areas in 2020
– Machine learning and statistical modeling for video streaming
– Volumetric media: from capture to consumption
– Fake media and tools for preventing illegal broadcasts
• A workshop (posters/demos) dedicated to middle and high-school students
• Two confirmed keynotes from Google and MIT
• Expecting reduced registration fees thanks to strong support
Important Dates Submit by
Research Track Jan. 10 (firm)
Demo Track Feb. 29
Open Source/Dataset Feb. 29
Workshops Mar. 27
Conference June 8-11
NEW
Visit http://acmmmsys.org today!
NEW
VBIM: Video QoE Dataset Generation
Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks
Cise Midoglu, Anatoliy Zabrovskiy, Özgü Alay,
Daniel Hölbling-Inzko, Carsten Griwodz, Christian Timmerer
Simula Research Laboratory, University of Klagenfurt,
University of Oslo, Bitmovin Inc
Open Source Software Competition
Thursday 24 October
10:30 - 12:00
Risso 6

Mais conteúdo relacionado

Mais procurados

CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming
CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video StreamingCSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming
CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming
Alpen-Adria-Universität
 
On Optimizing Resource Utilization in AVC-based Real-time Video Streaming
On Optimizing Resource Utilization in AVC-based Real-time Video StreamingOn Optimizing Resource Utilization in AVC-based Real-time Video Streaming
On Optimizing Resource Utilization in AVC-based Real-time Video Streaming
Alpen-Adria-Universität
 
Quality impact of scalable video coding tunneling for media aware content del...
Quality impact of scalable video coding tunneling for media aware content del...Quality impact of scalable video coding tunneling for media aware content del...
Quality impact of scalable video coding tunneling for media aware content del...
Alpen-Adria-Universität
 

Mais procurados (20)

EPIQ'21: Days of Future Past: An Optimization-based Adaptive Bitrate Algorith...
EPIQ'21: Days of Future Past: An Optimization-based Adaptive Bitrate Algorith...EPIQ'21: Days of Future Past: An Optimization-based Adaptive Bitrate Algorith...
EPIQ'21: Days of Future Past: An Optimization-based Adaptive Bitrate Algorith...
 
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
 
CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming
CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video StreamingCSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming
CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming
 
EADAS: Edge Assisted Adaptation Scheme for HTTP Adaptive Streaming
EADAS: Edge Assisted Adaptation Scheme for HTTP Adaptive StreamingEADAS: Edge Assisted Adaptation Scheme for HTTP Adaptive Streaming
EADAS: Edge Assisted Adaptation Scheme for HTTP Adaptive Streaming
 
PEMWN'21 - ANGELA
PEMWN'21 - ANGELAPEMWN'21 - ANGELA
PEMWN'21 - ANGELA
 
Video complexity analyzer (VCA) for streaming applications
 Video complexity analyzer (VCA) for streaming applications Video complexity analyzer (VCA) for streaming applications
Video complexity analyzer (VCA) for streaming applications
 
Policy-driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-driven Dynamic HTTP Adaptive Streaming Player EnvironmentPolicy-driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-driven Dynamic HTTP Adaptive Streaming Player Environment
 
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...
 
A Distributed Delivery Architecture for User Generated Content Live Streaming...
A Distributed Delivery Architecture for User Generated Content Live Streaming...A Distributed Delivery Architecture for User Generated Content Live Streaming...
A Distributed Delivery Architecture for User Generated Content Live Streaming...
 
On Optimizing Resource Utilization in AVC-based Real-time Video Streaming
On Optimizing Resource Utilization in AVC-based Real-time Video StreamingOn Optimizing Resource Utilization in AVC-based Real-time Video Streaming
On Optimizing Resource Utilization in AVC-based Real-time Video Streaming
 
20 Years of Streaming in 20 Minutes
20 Years of Streaming in 20 Minutes20 Years of Streaming in 20 Minutes
20 Years of Streaming in 20 Minutes
 
LwTE: Light-weight Transcoding at the Edge
LwTE: Light-weight Transcoding at the EdgeLwTE: Light-weight Transcoding at the Edge
LwTE: Light-weight Transcoding at the Edge
 
SLFC: Scalable Light Field Coding
SLFC: Scalable Light Field CodingSLFC: Scalable Light Field Coding
SLFC: Scalable Light Field Coding
 
Quality impact of scalable video coding tunneling for media aware content del...
Quality impact of scalable video coding tunneling for media aware content del...Quality impact of scalable video coding tunneling for media aware content del...
Quality impact of scalable video coding tunneling for media aware content del...
 
H2BR: An HTTP/2-based Retransmission Technique to Improve the QoE of Adaptive...
H2BR: An HTTP/2-based Retransmission Technique to Improve the QoE of Adaptive...H2BR: An HTTP/2-based Retransmission Technique to Improve the QoE of Adaptive...
H2BR: An HTTP/2-based Retransmission Technique to Improve the QoE of Adaptive...
 
What’s new in MPEG?
What’s new in MPEG?What’s new in MPEG?
What’s new in MPEG?
 
Scalable High Efficiency Video Coding based HTTP Adaptive Streaming over QUIC...
Scalable High Efficiency Video Coding based HTTP Adaptive Streaming over QUIC...Scalable High Efficiency Video Coding based HTTP Adaptive Streaming over QUIC...
Scalable High Efficiency Video Coding based HTTP Adaptive Streaming over QUIC...
 
HTTP Adaptive Streaming State of the Art and Challenges Ahead
HTTP Adaptive StreamingState of the Art and Challenges AheadHTTP Adaptive StreamingState of the Art and Challenges Ahead
HTTP Adaptive Streaming State of the Art and Challenges Ahead
 
Delivering Traditional and Omnidirectional Media
Delivering Traditional and Omnidirectional MediaDelivering Traditional and Omnidirectional Media
Delivering Traditional and Omnidirectional Media
 
FaME-ML: Fast Multirate Encoding for HTTP Adaptive Streaming Using Machine Le...
FaME-ML: Fast Multirate Encoding for HTTP Adaptive Streaming Using Machine Le...FaME-ML: Fast Multirate Encoding for HTTP Adaptive Streaming Using Machine Le...
FaME-ML: Fast Multirate Encoding for HTTP Adaptive Streaming Using Machine Le...
 

Semelhante a Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks

How to Optimize Dynamic Adaptive Video Streaming? Challenges and Solutions
How to Optimize Dynamic Adaptive Video Streaming? Challenges and SolutionsHow to Optimize Dynamic Adaptive Video Streaming? Challenges and Solutions
How to Optimize Dynamic Adaptive Video Streaming? Challenges and Solutions
Alpen-Adria-Universität
 
Digiturk_TV_Connect_2015
Digiturk_TV_Connect_2015Digiturk_TV_Connect_2015
Digiturk_TV_Connect_2015
Ozgur Ertem
 
Ultra-High-Definition Quality of Experience with MPEG-DASH
Ultra-High-Definition Quality of Experience with MPEG-DASHUltra-High-Definition Quality of Experience with MPEG-DASH
Ultra-High-Definition Quality of Experience with MPEG-DASH
Bitmovin Inc
 

Semelhante a Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks (20)

Bitmovin LIVE Tech Talks: Analytics for Workflow Automation (ft. Touchstream ...
Bitmovin LIVE Tech Talks: Analytics for Workflow Automation (ft. Touchstream ...Bitmovin LIVE Tech Talks: Analytics for Workflow Automation (ft. Touchstream ...
Bitmovin LIVE Tech Talks: Analytics for Workflow Automation (ft. Touchstream ...
 
"Edge/Cloud Tradeoffs and Scaling a Consumer Computer Vision Product," a Pres...
"Edge/Cloud Tradeoffs and Scaling a Consumer Computer Vision Product," a Pres..."Edge/Cloud Tradeoffs and Scaling a Consumer Computer Vision Product," a Pres...
"Edge/Cloud Tradeoffs and Scaling a Consumer Computer Vision Product," a Pres...
 
Ojoconsulting Oy Nimbus Monitoring Service description v1.2 public
Ojoconsulting Oy Nimbus Monitoring Service description v1.2 publicOjoconsulting Oy Nimbus Monitoring Service description v1.2 public
Ojoconsulting Oy Nimbus Monitoring Service description v1.2 public
 
Overcoming online video streaming challenges with better Quality-of-Experience
Overcoming online video streaming challenges with better Quality-of-ExperienceOvercoming online video streaming challenges with better Quality-of-Experience
Overcoming online video streaming challenges with better Quality-of-Experience
 
How to Optimize Dynamic Adaptive Video Streaming? Challenges and Solutions
How to Optimize Dynamic Adaptive Video Streaming? Challenges and SolutionsHow to Optimize Dynamic Adaptive Video Streaming? Challenges and Solutions
How to Optimize Dynamic Adaptive Video Streaming? Challenges and Solutions
 
PLNOG 17 - Stefan Meinders - Slow is the new Down
PLNOG 17 - Stefan Meinders - Slow is the new DownPLNOG 17 - Stefan Meinders - Slow is the new Down
PLNOG 17 - Stefan Meinders - Slow is the new Down
 
Virtual STB / Cloud UI Streaming revisited
Virtual STB / Cloud UI Streaming revisitedVirtual STB / Cloud UI Streaming revisited
Virtual STB / Cloud UI Streaming revisited
 
Join the Revolution: The Interconnected World with IBM Bluemix and IoT Founda...
Join the Revolution: The Interconnected World with IBM Bluemix and IoT Founda...Join the Revolution: The Interconnected World with IBM Bluemix and IoT Founda...
Join the Revolution: The Interconnected World with IBM Bluemix and IoT Founda...
 
Digiturk_TV_Connect_2015
Digiturk_TV_Connect_2015Digiturk_TV_Connect_2015
Digiturk_TV_Connect_2015
 
Монетизация сетевой инфраструктуры
Монетизация сетевой инфраструктурыМонетизация сетевой инфраструктуры
Монетизация сетевой инфраструктуры
 
IEEEGlobecom'22-OL-RICHTER.pdf
IEEEGlobecom'22-OL-RICHTER.pdfIEEEGlobecom'22-OL-RICHTER.pdf
IEEEGlobecom'22-OL-RICHTER.pdf
 
Web Information Systems and Technologies 2009
Web Information Systems and Technologies 2009Web Information Systems and Technologies 2009
Web Information Systems and Technologies 2009
 
Best practices for live streaming
Best practices for live streamingBest practices for live streaming
Best practices for live streaming
 
Set up box can become home IoT server
Set up box can become home IoT serverSet up box can become home IoT server
Set up box can become home IoT server
 
Bluemix Local – Relay Options and Challenges
Bluemix Local – Relay Options and Challenges Bluemix Local – Relay Options and Challenges
Bluemix Local – Relay Options and Challenges
 
Ultra-High-Definition Quality of Experience with MPEG-DASH
Ultra-High-Definition Quality of Experience with MPEG-DASHUltra-High-Definition Quality of Experience with MPEG-DASH
Ultra-High-Definition Quality of Experience with MPEG-DASH
 
Audi - TCU Project - H Schumacher
Audi - TCU Project - H SchumacherAudi - TCU Project - H Schumacher
Audi - TCU Project - H Schumacher
 
2307 - DevBCN - Otel 101_compressed.pdf
2307 - DevBCN - Otel 101_compressed.pdf2307 - DevBCN - Otel 101_compressed.pdf
2307 - DevBCN - Otel 101_compressed.pdf
 
“Seamless Deployment of Multimedia and Machine Learning Applications at the E...
“Seamless Deployment of Multimedia and Machine Learning Applications at the E...“Seamless Deployment of Multimedia and Machine Learning Applications at the E...
“Seamless Deployment of Multimedia and Machine Learning Applications at the E...
 
What's New in IBM Streams V4.2
What's New in IBM Streams V4.2What's New in IBM Streams V4.2
What's New in IBM Streams V4.2
 

Mais de Alpen-Adria-Universität

Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Alpen-Adria-Universität
 
Content-adaptive Video Coding for HTTP Adaptive Streaming
Content-adaptive Video Coding for HTTP Adaptive StreamingContent-adaptive Video Coding for HTTP Adaptive Streaming
Content-adaptive Video Coding for HTTP Adaptive Streaming
Alpen-Adria-Universität
 
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming StreamEvaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream
Alpen-Adria-Universität
 
Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-Driven Dynamic HTTP Adaptive Streaming Player EnvironmentPolicy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Alpen-Adria-Universität
 
Energy Consumption in Video Streaming: Components, Measurements, and Strategies
Energy Consumption in Video Streaming: Components, Measurements, and StrategiesEnergy Consumption in Video Streaming: Components, Measurements, and Strategies
Energy Consumption in Video Streaming: Components, Measurements, and Strategies
Alpen-Adria-Universität
 
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Alpen-Adria-Universität
 
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming ApplicationsSARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
Alpen-Adria-Universität
 

Mais de Alpen-Adria-Universität (20)

VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instances
VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instancesVEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instances
VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instances
 
GREEM: An Open-Source Energy Measurement Tool for Video Processing
GREEM: An Open-Source Energy Measurement Tool for Video ProcessingGREEM: An Open-Source Energy Measurement Tool for Video Processing
GREEM: An Open-Source Energy Measurement Tool for Video Processing
 
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
 
VEEP: Video Encoding Energy and CO₂ Emission Prediction
VEEP: Video Encoding Energy and CO₂ Emission PredictionVEEP: Video Encoding Energy and CO₂ Emission Prediction
VEEP: Video Encoding Energy and CO₂ Emission Prediction
 
Content-adaptive Video Coding for HTTP Adaptive Streaming
Content-adaptive Video Coding for HTTP Adaptive StreamingContent-adaptive Video Coding for HTTP Adaptive Streaming
Content-adaptive Video Coding for HTTP Adaptive Streaming
 
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...
 
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Vid...
Empowerment of Atypical Viewers  via Low-Effort Personalized Modeling  of Vid...Empowerment of Atypical Viewers  via Low-Effort Personalized Modeling  of Vid...
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Vid...
 
Optimizing Video Streaming for Sustainability and Quality: The Role of Prese...
Optimizing Video Streaming  for Sustainability and Quality: The Role of Prese...Optimizing Video Streaming  for Sustainability and Quality: The Role of Prese...
Optimizing Video Streaming for Sustainability and Quality: The Role of Prese...
 
Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...
Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...
Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...
 
Machine Learning Based Resource Utilization Prediction in the Computing Conti...
Machine Learning Based Resource Utilization Prediction in the Computing Conti...Machine Learning Based Resource Utilization Prediction in the Computing Conti...
Machine Learning Based Resource Utilization Prediction in the Computing Conti...
 
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming StreamEvaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream
 
Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...
Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...
Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...
 
Multi-access Edge Computing for Adaptive Video Streaming
Multi-access Edge Computing for Adaptive Video StreamingMulti-access Edge Computing for Adaptive Video Streaming
Multi-access Edge Computing for Adaptive Video Streaming
 
Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-Driven Dynamic HTTP Adaptive Streaming Player EnvironmentPolicy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment
 
VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...
VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...
VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...
 
Energy Consumption in Video Streaming: Components, Measurements, and Strategies
Energy Consumption in Video Streaming: Components, Measurements, and StrategiesEnergy Consumption in Video Streaming: Components, Measurements, and Strategies
Energy Consumption in Video Streaming: Components, Measurements, and Strategies
 
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
 
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine LearningVideo Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning
 
Optimizing QoE and Latency of Live Video Streaming Using Edge Computing a...
Optimizing  QoE and Latency of  Live Video Streaming Using  Edge Computing  a...Optimizing  QoE and Latency of  Live Video Streaming Using  Edge Computing  a...
Optimizing QoE and Latency of Live Video Streaming Using Edge Computing a...
 
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming ApplicationsSARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
 

Último

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Último (20)

Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 

Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks

  • 1. Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks Cise Midoglu1 , Anatoliy Zabrovskiy2 , Özgü Alay3 , Daniel Hölbling-Inzko4 , Carsten Griwodz5 , Christian Timmerer2,4 1 Simula Research Laboratory, 2 University of Klagenfurt, 3 Simula Metropolitan Center for Digital Engineering, 4 Bitmovin Inc, 5 University of Oslo OS-05
  • 2. Motivation ● Video streaming one of the top traffic contributors in the Internet ● Mobile broadband (MBB) networks becoming more and more prominent ● Metadata-rich measurement result collection is challenging ● Over-the-top (OTT) video analytics are not used widely in research OS-05 2
  • 3. Overview ● Automatised measurement and evaluation framework for video streaming Quality of Experience (QoE) OS-05 3
  • 4. Overview ● Automatised measurement and evaluation framework for video streaming Quality of Experience (QoE) ○ End-to-end with client and server side ○ Client-initiated active measurements ○ Docker virtualization → platform compatibility ○ Headless streaming → focus on objective QoE ○ Allows to monitor and collect data from multiple layers (application, transport, network, physical) ○ Allows to benchmark video players, ABR algorithms, networks, operators, ... OS-05 4
  • 5. Client Side ● Designed to emulate real user initiating a video streaming session ● Selenium instrumentation opens headless browser and streams from HTTP server ● Implemented as Docker container ● Compatible with mobile broadband testbeds (e.g., MONROE) ● Configurable (network, player, ABR algorithm, run duration, batch experimentation, ...) ● Additional network monitoring (ping + traceroute), and metadata if available OS-05 5
  • 6. Server Side OS-05 6 ● Server hosts landing pages with 3 different video players ○ Bitmovin Player v8 ○ Shaka Player v2.5 ○ DASH.js Player v2.9
  • 7. Server Side OS-05 7 ● All test pages use the same asset ○ BigBuckBunny video ○ Encoded in 15 qualities (100 Kbps to 15 Mbps) ○ Retrieved from CDN
  • 8. Server Side OS-05 8 ● All test pages are integrated with Bitmovin Analytics web collector v2.3 ○ JavaScript executed on client browser in runtime
  • 9. Server Side OS-05 9 ● All pages are integrated with Bitmovin Analytics web collector v2.3 ○ More than 70 parameters recorded for each session (including startup time, video quality, num. switches, stalls, ...)
  • 10. Server Side OS-05 10 ● All pages are integrated with Bitmovin Analytics web collector v2.3 ○ Possible to view metrics in real-time from the Bitmovin Dashboard, or export in raw format using the Bitmovin Analytics Export Service
  • 14. Use Cases and Intended Audience OS-05 14
  • 16. 16 • Two grand challenges – Improving open-source HEVC encoding – Low-latency live streaming • Focus areas in 2020 – Machine learning and statistical modeling for video streaming – Volumetric media: from capture to consumption – Fake media and tools for preventing illegal broadcasts • A workshop (posters/demos) dedicated to middle and high-school students • Two confirmed keynotes from Google and MIT • Expecting reduced registration fees thanks to strong support Important Dates Submit by Research Track Jan. 10 (firm) Demo Track Feb. 29 Open Source/Dataset Feb. 29 Workshops Mar. 27 Conference June 8-11 NEW Visit http://acmmmsys.org today! NEW
  • 17. VBIM: Video QoE Dataset Generation Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks Cise Midoglu, Anatoliy Zabrovskiy, Özgü Alay, Daniel Hölbling-Inzko, Carsten Griwodz, Christian Timmerer Simula Research Laboratory, University of Klagenfurt, University of Oslo, Bitmovin Inc Open Source Software Competition Thursday 24 October 10:30 - 12:00 Risso 6