Presentation at The International Conference on Theory and Practice of Digital Libraries (TPDL)

1. User Requirements in
Audiovisual Search
A Quantitative Approach
Danish Nadeem
Roeland Ordelman
Robin Aly
Erwin Verbruggen

2. AUDIOVISUAL ARCHIVE

3. BUSINESS ARCHIVE
DUTCH PUBLIC BROADCASTERS

4. DIGITIZATION

5. CLARIAH PRESENTATIE 11 September 2013 5
800.000 hrs

6. ?METADATA

7. Document level
vs
Segment level

8. CLARIAH PRESENTATIE 11 September 2013 8
TOOLS

9. 9
USEFUL?
Developer/
ICT researcher
User

10. CLARIAH PRESENTATIE 11 September 2013 10
FEEDBACK

11. Access to
Audiovisual
Archives
Content
Technology

13. ARCHIVAL METADATA
SUBTITLES

14. AUDIO ANALYSIS:
SPEECH/SPEAKER RECOGNITION

15. pose
beach
Luther King
Obama
Visual analysis

16. AUDIOVISUAL SEARCH

17. VIDEO HYPERLINKING

18. Broadcast professionals
Broadcast
Professionals
Re-use
Media Archivists Annotate

19. Research & Education
Broadcast
Professionals
Hergebruik
Media Archivists
(documentalisten)
Beschrijven
Journalists Research
Academic researchers Investigate
Education Illustrate

20. Home user
Public Entertainment
Edutainment

21. 21
Use Scenarios
&
System
Requirements
Interview
&
elicitation
sessions
Mock-up
creation &
evaluation
Prototype
evaluation
System
evaluation
Surveys &
log analysis
Qualitative
Qualitative
QualitativeQuantitative
Quantitative/
Qualitative

22. Quantitative approach
• Categorization of user requirements
• According to different user groups
• Prioritize implementation of system features
1. 2. 3.

23. Concept Mapping
• Data collection
• Multidimensional Scaling
• Hierarchical Cluster Analysis

24. Method
• Phase 1: “Idea generation”
–Caveat: unfamiliarity with A/V search
–Interviews, requirements elicitation
experiments using system mock-ups
–professionals, researchers, home user
–71 “statements”

25. Method (2)
• Phase 2: “Sorting & Rating”
–47 participants, evenly spread over 3 groups
–Categorize according to perceived similarity
• Create categories and label with description
–Rate according to desirability
• 1-5: undesirable – highly desirable

26. Categories vizualisation

27. Categories

28. User-defined search functions
Translates into:
1. having options for search manipulation and
result representation:
– change sort order of results (date, relevance)
– Use filters and activate them at any point during
search
– Use boolean operators
2. the system should be clear and guide users in
a rather complex search process

29. Advanced search
• Users are eager to make use of advanced search
options:
– Search using example image
– Events, persons, speakers, visual objects
– Using multiple metadata sources, e.g.,
• Archival metadata
• Speech transcripts
• Visual labels
• Less interest in “technical” metadata
– Shot types, camera movement, b/w-color

30. Help functions
• Slight miss-alignment with what developers
understand as “help functions”
• Next to “access to help manuals”:
– System should be fast
– Clear, user-friendly, intuitive UI
– Access to video
– Clear message when no results are found
– Consistent results

31. USER GROUP COMPARISON

34. DEVELOPMENT IMPLICATIONS
PRO
RESEARCH
HOME

37. Conclusions
• Quantitative approach using concept mapping
– Useful approach to get some more grip on user
requirements and differences between user
groups
– Helps to steer development process of advanced
user type specific A/V search tools
– User defined labels may not always be in-line with
formal definitions used by developers which may
cause confusions, e.g.,
• Help functions vs. clear, smooth and consistent system

38. Conclusions (2)
• Clear interest of users in
1. advanced search options
2. segment-level access points to AV by means of
rich multi-modal annotations (speech, speakers,
events, objects)
3. Clear, transparent, smoothly working system

39. Upcoming
STUDY
HOME USERS
&
VIDEO HYPERLINKING
@
BBC

40. http://www.axes-project.eu
Information Retrieval for
Information Services
http://www.project-infiniti.nl/