A/B testing has proved to be an effective tool for internet business. But sometimes, video gets a "set it and forget it" designation and this is a huge mistake. Read about what metrics you should measure when A/B testing your videos and some testing ideas that drive result.

1. Video
A/B Testing
& how it's different from Web A/B
testing

2. 1. What is A/B Testing?
2. Usage of A/B Testing
3. Video A/B Testing metrics
4. Video A/B Testing ideas

3. comparing two versions of a web page by
showing the two variants to similar
visitors at the same time. A/B test allows
you to see which variant performs better.
(noun)
A/B Testing

4. 1. WEBSITE 2. E‐COMMERCE
3. E‐MAIL CAMPAIGN 4. VIDEO
Goal: Increase conversion rate
and sign-ups
Goal: Increase product
purchases and improve buyer
experience
Goal: Increase open rates and
design effective campaigns
Goal: Increase audience
engagement and viewhour
Usage of A/B Testing

5. We have heard a lot about web,
mobile app A/B testing, but not
much about video A/B testing...

6. How is Video A/B
Testing Different?

7. VIEWHOUR
CTR (CLICK THROUGH RATE)
COMPLETION RATE
Video A/B Testing measures
different metrics other than
conversion rates
VIEWER ENGAGEMENT

8. Video A/B Testing
Ideas

9. Test #1. Video Thumbnails
A video thumbnail is the first thing the user sees when interacting
with a video. It’s a visual call‐to‐action.

10. The quality of your thumbnails needs to be
as sharp as possible.
Brightly lit, high-contrast images encourage
user to click the play button
Select the most exciting part of the video
Test different images for different devices
for the best visibility. Remember, much of
your traffic will come from mobile devices!
Tips

11. According to research done in Netherlands,
which examined thumbnails ranging from
60px to 110px, the bigger thumbnails
performed slightly better.

12. Test #2. Video Metadata
The video contains many types
of metadata, such as the title of
video, descriptions, tags.
Changing metadata is the
simplest way to A/B test video.

13. properly select titles to encourage viewers
play your video
video title

14. use language that is frequently searched for
video description

15. enter in words and phrases that describe
your video and are likely to be searched
tags

16. Test #3. Video Quality
High Video Quality
Higher Engagement,
Better Experience
≠

17. There's trade‐off between high resolution
and chance of rebuffering during playback,
which can lead to audience churn.

18. Find the optimal resolution that
maximizes user experience with the
least cost

19. It is impossible to maximize the QoE when a video is distributed
at a bit rate that is either too high or too low.
As a result, a video must be distributed at a bit rate that matches
network throughput to maximize the QoE.

20. Testing is a continuous process.
Keep testing and measure wisely.

21. Why Streaming Businesses need Video A/B Testing
Learn more about video A/B testing at our blog:
click!

22. Streamlyzer provides powerful video analytics to OTT service providers and
media companies to help make data-driven decisions. Our dashboard
delivers deep insights into video performance, audience behavior and
contents consumption patterns all in real-time across different devices.
Start 30 day free-trial