Steeple workshop - MediaMosa - Oxford, july 2011

Frans Ward
Senior Technical Product Manager
SURFnet Advanced Services

MediaMosa: Open Source Media Management
Software to Build an Open Video Platform
“Open Video in Education”
MediaMosa @ Steeple Workshop
Oxford, July 1 2011 - SURFnet. We make innovation work
`
Saturday, July 2, 2011

OVERVIEW

• About SURFnet
And our services. Brieﬂy...

• MediaMosa Introduction
What is it?

• MediaMosa Features
What can it do for you?

• MediaMosa Architecture
How is it build?

• Technology Scouting Projects
How can MediaMosa be of use here?



About SURFnet
• The SURFnet network is the
national computer network for
higher education and research in
the Netherlands (NREN)

• SURFnet is a subsidiary of the
SURF organization

• Not for proﬁt, 80 employees
• 180 connected institutions,
serving 1 million users

NREN, National Research and Education Network



The SURF organization
SURFfoundation

Institutions Strategic Direction
Policymaking
SURFnet

Task Organizations

Customer Relation

SURFdiensten



SURFnet Services
SURFnet provides advanced services to the
Dutch research and education community

High performance networking.
SURFnet plays a leading role in the development
of national, European and world-wide
networking.

Authentication and authorization
services to provide secure access to the
network and other resources.

Advanced multimedia collaboration
tools, including high quality audio/video
streaming and communication.

NREN, National Research and Education Network



SURFnet Video Services
Front-ends
Back-ends
SURFmedia
SURFnet’s online mediaportal
http://www.surfmedia.nl/
CDN

✓ Video On Demand (VOD)
✓ Live Streaming

Facts and Figures (June 2011)
• 97.610 assets
• 15 TB data
VP-Core
• 47.979 accounts Powered by
• 11.450 logins per month
• 43 institutions using federative logins
• 4 content suppliers
• 248.049 views per month



VP-Core
• Shared platform SURFnet and Kennisnet
• Application, streaming-, transcoding servers + storage
• Powered by MediaMosa

1 SURFnet. We make innovation work


DEMO SURFMEDIA
http://ww.surfmedia.nl/



MediaMosa
Open Source
Software to build a
Media Management and
Distribution Platform

In use by SURFnet and
Kennisnet on their
VP-Core platform since
July 2008

Main Entry: 1me·dia-mo-sa
Pronunciation: ˈmē-dē-ə-mō-ˈzā
Function: open source software to build a media
management and distribution platform
Release Date: 8 april 2009



MediaMosa
Architecture Blueprint

Applications
Front-end
‣ Based on a Service Oriented Architecture

‣ Separation of front-end and back-end
functionality

‣ Multiple end-user applications on a
centralized video backend infrastructure

‣ Flexibility: combining components

MediaMosa
‣ Performance and High availability

Back-end
‣ Scalable for future expansions

‣ Open source and open source
components !

➡ Common base for MediaMosa
is Drupal 7



REST
Representational State Transfer
• All interactions (messages) with [GET] .../asset?limit=10
the MediaMosa platform are done
with REST-calls. <?xml version="1.0"?>
<response>

• REST strictly refers to a <header>
<item_count>8</item_count>
collection of network <item_count_total>8</item_count_total>
<item_offset>0</item_offset>
architecture principles which <request_process_time>0.0728</request_process_time>
<request_query_count>55</request_query_count>
outline how resources are <request_result>success</request_result>
deﬁned and addressed. <request_result_description></
request_result_description>

• REST is a Client-server,
<request_result_id>601</request_result_id>
<request_uri>[GET] asset?
Stateless, Cacheable and limit=10&user_id=admin&is_app_admin=TRUE</
request_uri>
Layered protocol. <vpx_version>2.3.11</vpx_version>
</header>
<items>
✓ This reduces the complexity <item id="1">
<asset_id>ZG3SmyybQ61abezpbVHrJkFF</asset_id>
✓ improves the effectiveness of ..... etc
performance tuning
✓ increases the scalability of pure
server components



Webservices
Over 185, divided in services for....

• Play Video (PlayProxy HTML wrapper)
• Authentication (DBUS for EUA)
• Authorization
(Domain, REALM, Group or mixed)
• Upload (PUT, POST, FTP)
• Transcoding
• Media Management: media ﬁles, assets
and collections http://me
diamosa.o
• Search: Contextual Query Language r g/api
• Jobs
• Metadata and OAI/PMH
• Notiﬁcation
• Logging and Statistics



Flexible Metadata
Element Sets
Metadata Element Sets Provided:
• Standard Dublin Core (DC)
• Qualified Dublin Core (QDC)
• Learning Object Metadata (IEEE LOM)
• ‘Content Zoek Profiel’ (CZP / NL LOM)
Objects are organized in assets, media files and collections

CRUD REST-calls on all objects possible. i.e.:
• POST /asset/create?user=John
• GET /asset/$asset_id
• POST /mediafile/$mediafile?filename=NewName
• POST /collection/$coll_id/delete?user=John



Transcoding Services

Based on FFMPEG a complete, cross-platform solution to record, convert and stream
audio and video. It includes libavcodec - the leading audio/video codec library.



Access Management
Screening
Default: Media is accessible for everyone.
Option to set access restrictions for playing media on the
following properties:

• Domain, or group of domains:
i.e only accessible from .surfnet.nl
• Realm, or group of realms:
i.e. using SURFfederation
authentication infrastructure
• User, or group of users:
only give rights to user=john or
group "class-24"



Search Services
Simple Search:
• GET /asset?owner=John
• GET /asset?collection=7
Advanced Search using CQL level 2 :
• “(dc.title = foo OR qdc.title_alternative = bar)”
• “NOT (dc.title = foo AND dc.title = bar)”
• “^cat ^dog tree^”
http://www.loc.gov/standards/sru/specs/cql.html

Support for Apache SOLR as alternative
search engine!



Upload Services
• POST upload using End User Application
(limited to 2 GB)

• POST upload directly to MediaMosa Platform
using ticket system (limited to 2 GB)

• HTTP PUT upload using End User Application
(i.e. Java Upload Applet)

• FTP batch upload (“no” limits) including
metadata in XML ﬁle

• Quota per End User Application
• Support for Master / Slave content sharing MediaMosa
(Provider Application / CLA)



Metadata Harvesting
using OAI-PMH
• is a low-barrier mechanism for repository interoperability.
• Data Providers are repositories that expose structured metadata via
OAI-PMH.
• Service Providers then make OAI-PMH service requests to harvest
that metadata.
• OAI-PMH is a set of six verbs or services that are invoked within
HTTP.

http://oai.surfmedia.nl/request?verb=Identify
http://oai.surfmedia.nl/request?verb=ListSets
http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdc
http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_dc
http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_lom
http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=czp
http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdc&set=coll_id:794



MediaMosa Community Website
& Online DEMO environment

http://mediamosa.org

http://demo.mediamosa.org



TECHNOLOGY SCOUTING PROJECTS... PAST & PRESENT
• Rich Media Systems Compared • Transcripting Technology
• MediaMosa Building Block for • Open Live Streaming
Blackboard
• MediaMosa RichMedia
• MediaMosa and support for Application
other content
• Content Supplier Application
• Full text search engines • MediaMosa and Opencast
• Content in the Cloud Matterhorn
• MediaMosa and Open API • HTML5 Video

Sco uts
Technology
MediaMosa


MEDIAMOSA AND OPEN WEBSERVICES

Goal:
1) to provide an open
interface for sharing data
stored in a MediaMosa
environment

2) to consume data from
other open platforms and
to integrate this in
MediaMosa



MEDIAMOSA AND OPEN WEBSERVICES
PROOF OF CONCEPTS

http://api.mediamosa.surfnet.nl/



MEDIAMOSA RICH MEDIA END USER APPLICATION

Goal: to provide a rich media
presentation application using
MediaMosa for presenting weblecture
recordings
• Rich Media = Weblecture Recording
• 2 playback modes:
Video - Video or Video - Slides

• Using export of a MediaSite recording
• Automatically producing slides from video
• Demo available on MediaMosa demo-site:
http://demo.mediamosa.org/richmedia



MEDIAMOSA RICH MEDIA END USER APPLICATION

DEMO



MEDIAMOSA TRANSCRIPTING TECHNOLOGY

Disclosure
of
audiovisual
archives

UK National Film and Television Archive, Berkhamsted
http://www.ﬂickr.com/people/footage/




Disclosure
of
audiovisual
archives

• The number of AV-archives on the Internet
increases rapidly





Disclosure
of
audiovisual
archives

increases rapidly
• Archiving is not enough: disclosure and reusing is
required!





Disclosure
of
audiovisual
archives

increases rapidly
• Archiving is not enough: disclosure and reusing is
required!
• The use of speech technology is needed
(Reduce human effort).





Disclosure
of
audiovisual
archives

increases rapidly.





Disclosure
of
audiovisual
archives

increases rapidly.
• Archiving is not enough: disclosure and reusing
is required!





Disclosure
of
audiovisual
archives

increases rapidly.
is required!
• Adding Metadata is the key component here.





Disclosure
of
audiovisual
archives

increases rapidly.
is required!
• Adding Metadata is the key component here.
• The use of speech technology is needed
(Reduce human effort).



Adding metadata, the traditional approach:
Manual annotation

Huge amount of work
and no time-coded relations with video



Adding metadata, the new approach:
Exploiting Speech technology for
metadata generation
Audio Extraction

Speech Recognition
(Speech-to-Text)
Time-coded Transcript

Indexing and Search:
Search on fragment level




• Transcripting: conversion of speech
into a written or electronic text
document.

• Automatic Speech Recognition (ASR)
seems to be the ideal technology for
this.

• In combination with Optical Character
Recognition (OCR) of slides.

• Goal: to provide additional metadata
for searching in video / lecture
recordings.



DEMO’s SPEECH RECOGNITION

http://hmi.ewi.utwente.nl/showcases/Broadcast-news-demo
http://hmi.ewi.utwente.nl/showcases/Radio%20Oranje%20demo



The Technology Scout Project. The process is complex...



SCOUTING PROJECT
Lecture Recording

End User • Recording of Teacher
Application • Recording of Slides
• Reference material

Transcription Multi-Source
MediaMosa
by Spraak Player
• Recognize the Speech • Transcode into audio • Enhanced Search
• Produce time-coded • Store all into an asset • Optional Subtitles
Transcript • Mashup info
Partners:

MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work


OPEN SOURCE MULTI-SOURCE HTML5 PLAYER



Community Development Projects
RECORDING BOX LECTURE RECORDING



Picture in Picture, Chapter marking, Text
Recognition, Recording Player for Flash and
iPad




• Automatic publishing
• Create and use metadata
• Rich Media content
• All metadata searchable



MEDIAMOSA INNOVATION PROJECTS IN 2011
Weblecturing pilot with
the University of Groningen (RUG)



MEDIAMOSA DRUPAL MODULES

Dr upal 6
Drupal 7



MediaMosa Status & Roadmap
Available on
mediamosa.org
Release 2.3.11

Continued Development:
2011: Two major releases based on new Drupal 7 framework.
MediaMosa 3.0: focusses on Open Interfaces
MediaMosa 3.5: focusses on Transcripting Technology (speech-2-text)

Other MediaMosa Projects 2011:
• Weblecture Pilot MediaMosa - Matterhorn
• Proof of Concepts Transcripting Technology
• Proof of Concepts ﬂexible workﬂows
(Enhanced support for other content than audio/video)



MediaMosa 3.0
Focus on open interfaces, open standards and OpenSocial

MediaMosa OpenAPI interface:
Own interface in MediaMosa for support for
open REST calls and other related functions:
• Search
• oAuth
• oEmbed
• open upload
Open standards:
• JSON, ATOM feed
OpenSocial:
• a common API for social applications across multiple websites



1.  SURFfederatie SAML

+
2.  SURFteams (grouper)

+ =
3.  OpenSocial

+
4.  Collaboration tools



Functional Components

Supporting Services
•  SURFfederatie
•  SURFteams
•  OpenSocial

Campus Services External Services



OpenSource: www.OpenConext.org

Portal OpenSocial Container

Engine Block Platform Management interface

Sourcecode: Apache License, v2.0

Content: CC “Attr. 3.0 Unported”



WWW
MediaMosa Directions
http://mediamosa.org

Online Demo
Q&A
http://demo.mediamosa.org
sa
MediaMo
Forum MediaMosa
http://mediamosa.org/forum
MediaMosa

Issue Tracker
http://mediamosa.org/trac

Source Code
https://github.com/mediamosa

Slideshare
ur
http://www.slideshare.net/MediaMosa
yo
or
Twitter s f n!
http://twitter.com/mediamosa ank t io
Th en
att



Steeple workshop - MediaMosa - Oxford, july 2011

Recomendados

Recomendados

Mais conteúdo relacionado

Destaque

Destaque (12)

Semelhante a Steeple workshop - MediaMosa - Oxford, july 2011

Semelhante a Steeple workshop - MediaMosa - Oxford, july 2011 (20)

Mais de MediaMosa

Mais de MediaMosa (19)

Último

Último (20)

Steeple workshop - MediaMosa - Oxford, july 2011