This is a presentation about the utilisation of the "smart content paradigm" in digital archives and collections. The talk was given at the expert workshop “The Scent of Information” (at the Art University in Linz, Austria on February 13, 2009

1. Smart Archives
The Brave New Semantic World
Presentation at the Workshop
“The Scent of Information”
February 13-14, 2009
Art University / Audimax
Kollegiumgasse 2, 4010 Linz
Georg Güntner
Salzburg Research Forschungsgesellschaft m.b.H.
Jakob Haringer Straße 5/3 | 5020 Salzburg, Austria Credits to: Iron Maiden (2000)
T +43.662.2288-DW | F +43.662.2288-222
georg.guentner@salzburgresearch.at
www.salzburgresearch.at

2. Structure
| Basic ideas about “Smart Archives” and the role of semantics
| Case study: Smart Content Factory
| Case study: Smart Media Archive
| Case study: Live Staging of Media Events (LIVE)
| Case study: Single Point of Access Semantic Media Repository
Framework (SAMY)
| Conclusions
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 2

3. Abstract
| In his talk Georg Güntner will summarize personal experiences with
knowledge-based approaches in rich media archives and collections. The
presentation will be based on three recent research projects which are in
different states of realization: “Smart Media Archives” developed a
semantically-enhanced index for ORF’s (the Austrian Broadcasting
Corporation) media archive. “LIVE Staging of Media Events” showed ways to
combine external knowledge spaces with media clips in real-time. Finally,
“SAMY” a project conducted in co-operation with LBI Linz and basis wien (a
documentation centre for contemporary art) aims at the creation of a single
point of access semantic media repository framework for cultural collections
and archives.
| Georg Güntner is head of the application area “Digital Media” at Salzburg
Research and in this function also leads Salzburg NewMediaLab, a centre of
excellence for applied research, combining approaches from multimedia
content management, semantic technologies and social software to create
new content structures and behavior, also denoted as “smart content”.
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 3

4. Context - Salzburg Research
| Founded in 1996, Salzburg Research
(SRFG) is the regional non-profit research
organisation of the State of Salzburg
| Salzburg Research is located at Techno-Z Salzburg
which focuses on Information and Communication
Technologies (ICT)
| SRFG employs about 70 people,
its turnover is 5,1 Mio. Euro (2008)
| Thematic areas (ICT with a focus on new media)
Knowledge and media management
|
Intelligent mobility
|
Educational innovation & Web technologies
|
IT-security and QoS-networks
|
eTourism and eInnovation
|
eCulture
|
| ICT is applied to application areas relevant to the
region of Salzburg (culture, tourism, new media,
learning)
| The core activities include applied research,
coordination and networking, know-how transfer and
www.salzburgresearch.at
market development
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 4

5. Context - Salzburg NewMediaLab
| Salzburg NewMediaLab (SNML) is the
Austrian Centre of Excellence in the area of
digital content engineering (type of research:
application oriented; 2003-2009)
Multimedia content management
|
Semantic technologies
|
Social software
|
Knowledge technologies
|
| Based on public-private partnership; funding
partners: Austrian Ministry for Economic
Affairs, State of Salzburg
| Cooperative research projects including 6
www.newmedialab.at
industrial partners and 5 research
organisations
| Co-ordinator and legal representative of
SNML: Salzburg Research
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 5

6. Economic Drivers for “Smart Archives”
| The markets:
Corporate, community based & personal audiovisual collections
|
(archives, libraries): spanning from YouTube to the Austrian National
Library
Media producers: broadcasters, film and games industry
|
Learning applications, industrial applications
|
„Embedded publishers“, “Embedded archives”
|
Media analysts
|
| The „prosumer crisis“ as a driving factor:
Consumers become producers
|
Content production gets easier: The amount of manageable assets
|
explodes.
Professional content production is expensive: re-use is mandatory
|
Solutions of the prosumer crisis depend heavily on improvements of
|
the search and retrieval process
Bridge the semantic gap! Be visionary!
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 6

7. Vision – „Smart Content Factory“
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 7

8. The Ingedients of Smart Archives
| Content –
The “archive”
| Domain model
(internal and
increasingly
external sources)
| Intelligent
content model
(smart content) User
| Applications to
manage, Information Conceptua-
Topic
browse and Object lisation
visualize
Content
archival content
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 8

9. Domain Ontologies – an Example
Musical Terminology Musical forms
(e.g. synonyms, classification) (z.B. musical genres and
forms)
Musical facts
(Instances: e.g. works,
composers, titles)
Geographic names
(places, regions, districts,
countries, areas)
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 9

10. Themen:
Linked Open Data (oder “Web of Data”)
by http://esw.w3.org/topic/SweoIG/
TaskForces/CommunityProjects/
LinkingOpenData
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 10

11. Smart Content
| Definition:
| The term denotes a concept for new type of digital content developed in
the course of a strategic study for the European Commission (EP2010).
Smart Content is designed to close the gap between the increasing ease
of media creation and the requirement of personalized, context-driven
content delivery and consumption.
| The concept is based on “intelligent content models” combining content
and knowledge by means of domain knowledge models and offering a set
of facets to access not only content and metadata, but also describing its
“behavior”.
| http://ep2010.salzburgresearch.at/
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 11

12. Themen
Spivak’s “Future Web”
© Nova Spivak
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner).

13. Case Study: Smart Content Factory
| Vision:
Development of a prototype of
|
a knowledge-based
audiovisual archive and
navigation system for TV,
radio and online broadcasts
Increasing the utilization of
|
audiovisual content
repositories
| Duration: 10/2003 - 09/2006
| Volume: 735.000 €
| Efforts: 80 PM
| Partners:
ORF
|
X-Art ProDivision
|
Joanneum Research
|
Salzburg Research (co-
|
ordinator)
http://scf.salzburgresearch.at/
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 13

14. Navigation Principles in the Smart Content Factory
SCF Results – Views
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 14

15. Video Summary View
Developed by Joanneum
Research (ActiveX-
technology)
Alternative view available
developed by Salzburg
Research (Javascipt-
technology)
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 15

16. Case Study: Smart Media Archive
| Vision:
Management of corporate
|
media archives
Opening archives for user
|
generated content (e.g. tell a
story about an image)
Meaningful relations between
|
archival content and user
generated content
Intelligent search and
|
navigation
| Duration: 01/2006 - 12/2009
| Partners:
mediamid digital services
|
Salzburg Research (co-
|
ordinator)
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 16

17. Article
Annotations and
meta information
Rating
A „story“: UGC (Wiki-like style)
Thesaurus
(topics)
Case study: Smart Media Archive
Related articles
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 17

18. Production support in the area
of interactive multistream TV shows
(a challenge for ipTV – www.ist-live.org)
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 18

19. Intelligent Media Framework - Modelling the Staging Domain
| Automatic annotators
| Human annotators
| Editor
| Video
conductor
Event
| Consumer
Intelligent
User
Content
Content
Model
| Content
Staging
formats
| Stream profiles
| Stream interrelation
| Audience profile
Production
Archive
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 19

20. Production Environment: IMF Message Console
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 20

21. Case Study: SAMY
Single Point of Access Semantic Media Repository Framework
| Objectives
Design, implementation and evaluation of a framework for (media) art
|
archives based upon
| an asset management system, and und
| the management of ontology-based semantic metadata in an RDF triple store
Access to these metadata via a „Single Point of Access“
|
| Duration: 07/2003(*) - 12/2009
(*) The project has been conducted
by LBI earlier
| Partners:
LBI Medien.Kunst.Forschung.
|
Basis Wien
|
Salzburg Research (co-ordinator)
|
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 21

22. SAMY: Domain Model and Architecture
| The SAMY ontology
comprises the following
main concepts (domain
model), e.g.
Asset
|
Team
|
Community
|
Material
|
Person
|
Award
|
Role
|
Event
|
Work-Project
|
Version
|
SAMY - architectural layers
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 22

23. Conclusions: A “Recipe” for Smart Archives
| Use existing content (URIs)
| Define the scope of your application
| Define an appropriate content model
Is the content invariant to the semantic approach? Must the
|
structures change?
| Integrate existing information sources
Production metadata (speakers, editing), archival data,
|
playout systems, EPGs
Consider creating links to other sources
|
| Test metadata extraction tools
| Consider metadata annotation
Is social tagging an alternative?
|
| Define an appropriate domain knowledge model
Scope, expressiveness, acceptance
|
| Implement the semantic indexing process
| Integrate the system in the production / archiving
workflow
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 23

24. Modelling the Domain (Three Dimensions)
Model
Which parts of
Scope
semantics are
modelled?
How is the
perspective of the
ontology onto the
knowledge of the
users?
Level of
Expressiveness
What kind of semantics is used?
Model
What kind of semantics are required to
Acceptance
fulfil requirements?
What are the user communities using the
ontology?
Which communities accept the ontology? © DynamOnt
Austrian research project
FIT-IT Semantic Systems Programm
(2005 – 2007)
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner).

25. Kontakt
| Information
www.salzburgresearch.at
|
www.newmedialab.at
|
www.ist-live.org
|
www.importnet-project.org
|
ikewiki.salzburgresearch.at
|
www.kiwi-project.eu
|
scf.salzburgresearch.at
|
| Kontakt
Salzburg Research
Güntner Georg
| Jakob Haringer Straße 5/III
T: +43.662.2288.400, M: +43.664.2807149
A-5020 Salzburg
georg.guentner@salzburgresearch.at
Austria/Österreich
Fax: +43.662.2288.222
17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 25