1. Smart acceleration of video lectures
Data Science Conference Adria | Zagreb 2023
Sead Delalić, PhD | University of Sarajevo

2. Agenda

3. Agenda
Introduction & Motivation

4. Agenda
Introduction & Motivation
Similar researches

5. Agenda
Introduction & Motivation
Similar researches
Implemented approaches

6. Agenda
Introduction & Motivation
Similar researches
Implemented approaches
Experiment & Results

7. Agenda
Introduction & Motivation
Similar researches
Implemented approaches
Experiment & Results
Future work & Conclusion

8. Sead Delalić

9. Sead Delalić
● PhD in Computer Science
○ University of Sarajevo
○ Optimization, Data mining, AI

10. Sead Delalić
● PhD in Computer Science
○ University of Sarajevo
○ Optimization, Data mining, AI
● Assistant Professor
○ Faculty of Science, University of Sarajevo
● AI Consultant/Engineer
○ 5+ years of experience in AI industry
● 25+ research/scientific paper

11. Introduction & Motivation

12. Introduction

13. Introduction
Online platforms

14. Introduction
Online platforms
Video platforms

15. Introduction
Online platforms
Video platforms
Large amounts of data

16. Video & Learning platforms

17. Video & Learning platforms
Video lectures

18. Video & Learning platforms
Video lectures
MOOC

19. Video & Learning platforms
Video lectures
MOOC
User interactions

21. Remarks

22. Remarks
Students watch video lectures in short segments

23. Remarks
Students watch video lectures in short segments
Attention span decreases with video length

24. Remarks
Students watch video lectures in short segments
Attention span decreases with video length
Repetitive content

25. Remarks
Students watch video lectures in short segments
Attention span decreases with video length
Repetitive content
Engagement correlates with better performance

26. Research of interest
“How video production affects student engagement: An empirical study of mooc videos” Guo et al, 2014

27. Research of interest
“How video production affects student engagement: An empirical study of mooc videos” Guo et al, 2014
Lecture duration should be limited to 6 minutes

28. Research of interest
“How video production affects student engagement: An empirical study of mooc videos” Guo et al, 2014
Lecture duration should be limited to 6 minutes
Shorter lectures lead to greater interest

29. How do we solve this problem?

30. Video Acceleration & Content Skipping

31. Video Acceleration & Content Skipping
Linear acceleration

32. Video Acceleration & Content Skipping
Linear acceleration
Up to 2x

33. Video Acceleration & Content Skipping
Linear acceleration
Up to 2x
Skipping

34. Video Acceleration & Content Skipping
Linear acceleration
Up to 2x
Skipping
Can we do something smarter?

35. Non-linear acceleration of video lectures

36. Non-linear acceleration of video lectures
Smart acceleration of video lectures

37. Implemented Approaches

38. Silence Removal

39. Silence Removal

40. Silence Removal
Removing silence during audio playback

41. Silence Removal
Removing silence during audio playback
Eliminating pauses in speech

42. Silence Removal
Removing silence during audio playback
Eliminating pauses in speech
Removing matching frames from a video

45. The initial results

46. The initial results
Video shortened up to 40%

47. The initial results
Video shortened up to 40%
Resulting video is harder to follow

48. The initial results
Video shortened up to 40%
Resulting video is harder to follow
The pauses are there for a reason

49. Viewing history-based acceleration

50. Viewing history-based acceleration

51. Viewing history-based acceleration
Viewing history data

52. Viewing history-based acceleration
Viewing history data
Number of viewers at each moment

53. Viewing history-based acceleration
Viewing history data
Number of viewers at each moment
Several issues and observations
“Understanding in-video dropouts and interaction peaks inonline lecture videos”, Kim et al., 2014

55. 55.2% of viewers do not
watch the video to
completion

56. 55.2% of viewers do not
watch the video to
completion
36.6% of viewers abandon the
video within the first 3
seconds

57. 55.2% of viewers do not
watch the video to
completion
36.6% of viewers abandon the
video within the first 3
seconds
Meaningful peaks

58. #
views
Time (sec)
Fitting curve

59. #
views
Time (sec)
Fitting curve

60. Experiment

61. Experiment

62. Experiment
Online platform

63. Experiment
Online platform
100 participants

64. Experiment
Online platform
100 participants
Four video types
- Original video
- Linear (L)
- Silence Removal (SR)
- Viewing history-based acceleration (HB)

67. Initial Results

68. Initial results
Original video performs significantly better statistically

69. Initial results
Original video performs significantly better statistically
Linearly accelerated video performs worst

70. Initial results
Original video performs significantly better statistically
Linearly accelerated video performs worst
HB acceleration yields significantly better results than silence removal and
linear acceleration

71. Conclusion & Future work

72. New ideas…

73. New ideas…
Using OpenAI models

74. New ideas…
Using OpenAI models
But not ChatGPT

75. New ideas…
Using OpenAI models
But not (only) ChatGPT

76. New ideas…
Using OpenAI models
But not (only) ChatGPT
Whisper for transcription

77. New ideas…
Using OpenAI models
But not (only) chatGPT
Whisper for transcription
Analyse transcriptions

78. More advanced ideas for platforms…

79. More advanced ideas for platforms…
Tracking user knowledge

80. More advanced ideas for platforms…
Tracking user knowledge
Removing known sections during playback

81. Conclusion

82. Conclusion
Relatively unexplored topic

83. Conclusion
Relatively unexplored topic
Numerous possibilities and diverse applications

84. Smart acceleration of video lectures
Data Science Conference Adria | Zagreb 2023
Sead Delalić, PhD | University of Sarajevo