This document describes a demonstration of a system for semantically enhanced interactive television production of mass media events. The system uses an "Intelligent Media Framework" to aggregate, store, propagate, filter and visualize contextual information from large events involving thousands of athletes, officials and parallel video feeds. Semantic annotations are applied to content to extract knowledge that can then be used for recommendations and personalization within a real-time, nonlinear, interactive and multi-channel television production. The goal is to develop intelligent tools and models to support the complex knowledge and information needs of live staging processes for major media events.

1. Utilizing Semantics in the
Production of iTV Shows
European Semantic Web Conference (ESWC 2009)
Demonstration paper
Georg Güntner, Dietmar Glachs, Rupert Westenthaler
Salzburg Research Forschungsgesellschaft m.b.H.
Date: 03/06/2009
Location: Hersonissos, Greece
Presenter: Georg Güntner

2. Ingredients of the Demo
• Starting point: Imagine a mass media • Implementation
event with – Development of a real-time production
– 23.000 athletes support system
– 14.000 officials – “Intelligent Media Framework” based
– 6.500 events on semantic concepts deals with
• aggregation
– 1.100 teams
• storage
– 12 parallel video • propagation
live feeds • filtering
– 200 archival clips • visualisation
• The vision: The production of a of contextual information
– real-time – Annotation, detection and
– non-linear extraction of “knowledge”
– interactive – Recommendation and
– multi-channel (5 channels) personalisation
video show in broadcasting quality • Performance indicators (field trial)
– 3 x 2 x 5 x 5h = 150h of material
– 110.000 action messages sent
– 18.000 terms in 65 vocabularies
– 100.000 activities detected and stored
– 18.000 knowledge items created
(c) LIVE Consortium, 2009 (www.ist-live.org) 02 June 2009 2

3. Scientific and Technological Challenges
• Development of an intelligent content model
– Understanding of the LIVE domain (broadcasting, events, staging,
sports, …)
Subject Matter Professional
– Research on knowledge and Annotation User
conceives
information requirements of the Information
interprets
expresses
Propositional
LIVE staging process. contains
Item Description
subclass of
Intelligent realises
– Foundational grounding for Media Asset
contains
Content
about
Content
Classification
Item Description
interactions between content Content
• NewsML
• MPEG 7
Structured
Classification
and knowledge Annotation Event
Situation
Staging
Situation
• Development of an intelligent media framework
– Understand standards of the domains (MPEG-7, NewsML, IPTC, …)
– Information integration for internal and external information sources
– Storage of and access to intelligent content objects
– Support the real-time character of the LIVE staging environment
(c) LIVE Consortium, 2009 (www.ist-live.org) 02 June 2009 3

4. The Knowledge Model
Term model Activity model
Extension of SKOS
Part of the event domain model
attitude
Role Task
towards
Individual
plays sequenced by
Course
acted by
Agent performs Activity Design
sequenced by
acts for
proper part
Social- member of
Individual participate satisfies
subclass of
Event
Group
setting for
Event
Setting
Event domain model Intelligent content model (media assets)
Based on the participation and the agent-activity pattern Based on the information object design pattern
(c) LIVE Consortium, 2009 (www.ist-live.org) 02 June 2009 4

5. The LIVE Production Support Toolset
Staging console support
Feedback analysis
Recommender tool
Human annotation tool system
LIVE production
(c) LIVE Consortium, 2009 (www.ist-live.org) 02 June 2009 5

6. LIVE Staging of Media Events
Follow us into the era of semantically
enhanced interactive TV production.
See you soon
in the demo session!
(c) LIVE Consortium, 2009 (www.ist-live.org) 02 June 2009 6

7. Contact
• Further information
– Web site: www.ist-live.org (see D7.4 for a reference to the IMF)
– Showcase website (soon): www.ist-live.org/showcase
– info@ist-live.org
• Presenters:
– Georg Güntner
georg.guentner@salzburgresearch.at
– Dietmar Glachs Salzburg Research
dietmar.glachs@salzburgresearch.at Jakob Haringer Strasse 5/3
– Rupert Westenthaler A-5020 Salzburg
rupert.westenthaler@salzburgresearch.at Austria
www.salzburgresearch.at
(c) LIVE Consortium, 2009 (www.ist-live.org) 02 June 2009 7