Video Summarization and Re-use Technologies and Tools

1. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Lyndon Nixon
MODUL Techology
Vienna, Austria
Tutorial at IEEE ICME 2020
Section II.1: Optimal usage of
summarization in media
collections for digital marketing
Video Summarization and Re-use
Technologies and Tools
Part II: Video summary (re-)use and
recommendation

2. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Tutorial’s structure and time schedule
2
Part II: Video Summaries Re-use and Recommendation
⚫ Section II.1: Optimal usage of summarization in media collections for digital marketing
(20' )
⚫ Q&A (5’)
⚫ Section II.2: Finding the best topic for selecting a media asset for summarization (20’)
⚫ Q&A (5’)
⚫ Section II.3: Recommending and scheduling media summaries for publication (20’)
⚫ Q&A (5’)
⚫ Closing words

3. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
3
Video is everywhere!  How to get your audiences’ attention?
Business value of video summaries
⚫ Consumers watch a full length video asset after being exposed to a summary
(advertisement or trailer)
⚫ Attention spans towards video on digital channels are dropping
⚫ Many channels have focused their content distribution on short-form video
(stories)
Digital marketing of video content requires optimal summarization

4. Viewing of linear broadcast TV is
decreasing while time spent with digital
content on Catchup TV, on-demand OTT
or social media rises.
Broadcaster audiences are fragmented
across digital channels and digital channels
are full of competing content offers for
their limited attention.
The TV industry is still catching up with
their online competition in the use of Web
technology: user tracking, personalisation
and targeting.

5. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
5
Video summaries within a media analytics workflow

6. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
6
Video summaries within a media analytics workflow
Finding the best topic for a
video summary publication

7. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
7
Video summaries within a media analytics workflow
Finding the best time and
channel to publish on

8. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
8
Video summaries
within a media
analytics
architecture

9. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
9
End tools for use with video summarization

10. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
10
Use of video summarization in digital marketing
Which of my media assets
should I promote on social
media in the coming
week?

11. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
11
Use of video summarization in digital marketing

12. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
12
Use of video summarization in digital marketing
Vector
Optimal
Length (s)
Maximum Length (s)
Summary Length
(s)
Ratio
pre-set pre-set
Twitter
30
60 - 90 140
30
60 - 90
2:1
'Recommended
Aspect Ratio: 16:9
(landscape or
portrait), 1:1
(square)'*
Facebook (feed)
120
60 - 90 14400
120
60 - 90
16:9
1:1
Facebook (stories) 20 120 (ads?) 20 9:16
Instagram (feed) 3060 (120 for ads?) 30
1.91:1, 4:5
1:1
Instagram (stories) 15 120 (ads?) 15 9:16
TikTok 15 60 15 9:16

13. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
13
Use of video summarization in digital marketing
Select content
for promotion
Select channel
for publication
Configure video
summarization
Identify topics of
interest to the
future audience

14. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
14
Use of video summarization in digital marketing
Select content
for promotion
Select channel
for publication
Configure video
summarization
Identify topics of
interest to the
future audience

15. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
15
Use of video summarization in digital marketing
Select content
for promotion
Select channel
for publication
Configure video
summarization
Identify topics of
interest to the
future audience

16. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
16
Use of video summarization in digital marketing
Select content
for promotion
Select channel
for publication
Configure video
summarization
Identify topics of
interest to the
future audience

17. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
17
Use of video summarization in digital marketing
Schedule time of
publication
Target the right
audience
Configure video
summarization
Publish & track
success

18. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
18
Use of video summarization in digital marketing
Publish & track
success

19. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Lyndon Nixon
MODUL Techology
Vienna, Austria
Tutorial at IEEE ICME 2020
Short break; coming up:
Section II.2: Finding the best
topic for selecting a media asset
for summarization
Video Summarization and Re-use
Technologies and Tools
Part II: Video summary (re-)use and
recommendation

20. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Lyndon Nixon
MODUL Techology
Vienna, Austria
Tutorial at IEEE ICME 2020
Section II.2: Finding the best
topic for selecting a media asset
for summarization
Video Summarization and Re-use
Technologies and Tools
Part II: Video summary (re-)use and
recommendation

21. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
The Topics Compass
21
Identify topics of
interest to the
future audience

22. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
The Topics Compass
22

23. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
The Topics Compass
23
International news articles
Online pages about TV content on
broadcasters Websites
Social media accounts about TV
content
TV Program information from EPG
data
Related content (mentioning a TV
program) from social media

24. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Success metrics: frequency (impact), sentiment
(disagreement) and WYSDOM

25. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Prediction: what is the best topic to choose on a
future date?
Our events and anniversaries API
highlights important events and
anniversaries on a specific date.
The Topics Compass can identify
time references in documents and
aggregate those documents that
refer to a specific date

26. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Prediction: what is the best topic to choose on a
future date?
Left: RBB,
DACH media,
Oct 31-Nov 1
2020
Right: NISV,
all media, Jun
20-30 2020.
Bookmarks
‘cultural
heritage’ and
‘events’.

27. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Prediction: what is the best date to choose for a
certain topic?
Left: RBB, all media, Jun 10-Dec 31
2020. Bookmark “Airports”.
Right: NISV, all media, Jun 10-Dec 31
2020. Bookmark “Events”.

28. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Topics Compass: demo

29. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Lyndon Nixon
MODUL Techology
Vienna, Austria
Tutorial at IEEE ICME 2020
Short break; coming up:
Section II.3: Recommending and
scheduling media summaries for
publication
Video Summarization and Re-use
Technologies and Tools
Part II: Video summary (re-)use and
recommendation

30. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Lyndon Nixon
MODUL Techology
Vienna, Austria
Tutorial at IEEE ICME 2020
Section II.3: Recommending and
scheduling media summaries for
publication
Video Summarization and Re-use
Technologies and Tools
Part II: Video summary (re-)use and
recommendation

31. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
The Content Wizard
31
A Web based tool to:
⚫ Find a video in your
collection matching a
chosen topic
⚫ Summarize it
according to the
intended channel of
publication
⚫ Schedule its
publication to the
target audience
Select content
for promotion
Select channel
for publication
Configure video
summarization

32. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
The Content Wizard
32

33. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
The Content Wizard
33

34. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Integration of the video summarization
34

35. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
The Content Wizard
35

36. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Including text summarization
36

37. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Advanced video recommendation
37
Content sWitch
- Replacing „general
audience“ trailers in
media streams with
recommended trailers
according to the
audience segmentation
4U2
- Publishing content
summaries on trending
topics via
messaging/chatbots
scheduled at an optimal
time

38. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
The Content Wizard: demo
38

39. retv-project.eu @ReTV_EU @ReTVproject retv-project retv_project
Lyndon Nixon
ReTV project co-ordinator
CTO, MODUL Technology
info@retv-project.eu
This work has received funding from the
European Union’s Horizon 2020 research
and innovation programme under grant
agreement H2020-780656 ReTV
Closing Words
Stay up to date with the ReTV
newsletter or get first access to new
tools by signing up as a ReTV
stakeholder! Follow our social
networks (below) & stay in touch!
nixon@modultech.eu