MediaMosa: overview, architecture and how it fits with Opencast Matterhorn

Frans Ward

Technical Product Manager
SURFnet Advanced Services
Frans.Ward@surfnet.nl

MediaMosa: overview, architecture
and how it ﬁts with Opencast
UNINETT Lecture Recording Workshop
Trondheim, October 6, 2010
`

Overview
30 min.

SURFnet, Videoservices,
MediaMosa overview,
architecture and features
20 min.

MediaMosa in relation with
Technology Scouting Projects &
Weblecture Recording
20 min.

MediaMosa in relation with
Opencast Matterhorn
20 min.

Questions

About SURFnet
• It is SURFnet’s mission to facilitate
groundbreaking education and research
through innovative network services.

• The SURFnet network is the national
computer network for higher education
and research in the Netherlands

• SURFnet is a subsidiary of the SURF
organization

• Not for proﬁt, 75 employees
• 180 connected institutions,
1 million users

UNINETT Lecture Recording Workshop - Trondheim, October 6, 2010
SURFnet. We make innovation work

The SURF organization

Policymaking

Task Organizations

Demand aggregation since 1985, not for profit


SURFnet Services
SURFnet provides advanced services to the
Dutch research and education community

High performance networking.
SURFnet plays a leading role in the development
of national, European and world-wide
networking.

Authentication and authorization
services to provide secure access to the
network and other resources.

Advanced multimedia collaboration
tools, including high quality audio/video
communication.

NREN, National Research and Education Network

SURFnet Video Services
1998 Audio & Video hosting service (FTP) - 1st generation

2003 SURFnet Video Portal (SVP) - 2nd generation

2005 SURFnet-TV Live Netcasting

2007 Start new generation video services - 3rd generation


3rd generation Video Services
Architecture Requirements

Front-end
SURFmedia
‣ Based on a Service Oriented Architecture
(SOA)

‣ Separation of frontend and backend
functionality

‣ Multiple end-user applications on a
centralized video backend infrastructure

MediaMosa
Back-end
‣ Flexibility: combining components

‣ Performance and High availability

‣ Scalable for future expansions

‣ Open source and open source
components !


SURFmedia
SURFnet’s online mediaportal


SURFmedia
SURFnet’s online mediaportal

Front-end


SURFmedia
Facts and Figures
+/ 35.000 user accounts
-

+/ 85.000 videos
-

+/ 250.000 requested streams per month
-

+/ 15 TB of video assets
-

Content Suppliers:


MediaMosa
Architecture Blueprint

• Common base for MediaMosa
is Drupal:
✓ Open Source
✓ Content Management System
✓ Web Application Framework
✓ Modulair, Hook-oriented and Scaleable

• Service Oriented Architecture (SOA)
• REST on the outside,
REST on the inside

• Scalability, Redundancy, High Availability

MediaMosa
Architecture Blueprint
Back-end
• Common base for MediaMosa
is Drupal:
✓ Open Source
✓ Content Management System
✓ Web Application Framework
✓ Modulair, Hook-oriented and Scaleable

• Service Oriented Architecture (SOA)
• REST on the outside,
REST on the inside

• Scalability, Redundancy, High Availability

MediaMosa
Open Source - GPLv2
Software to build a
Media Management and
Distribution Platform

Partner for development:

Main Entry: 1me·dia-mo-sa
Pronunciation: ˈmē-dē-ə-mō-ˈzā
Function: open source software to build a media
management and distribution platform
Release Date: 8 april 2009

1 SURFnet. We make innovation work

MediaMosa is.....


MediaMosa is..... (summary)


Open Source (GPLv2) Software



For building an online delivery
and media management platform




For (streaming) video, audio and in fact any content





Features ﬂexible metadata sets and transcoding services






Modular and based on the Drupal framework,
using REST principles






Modular and based on the Drupal framework,
using REST principles

MediaMosa is the basis for various successful
video services that SURFnet provide to
the Dutch educational sector


MediaM
osa is th
video se e bas
rvices th is for various su
at SURF c
the Dut
ch educ net prov cessful
ational s ide to
ector

Intern Seminar, 16 November 2009
SURFnet, Pioneering Network for Higher Education and Research

REST Modular
and base
d on the
using RE Dru
ST princ pal framework,
iples
Representational State Transfer
• All interactions (messages) with
the MediaMosa platform are done [GET] .../asset?limit=10
with REST-calls. <?xml version="1.0"?>
<response>

• REST strictly refers to a <header>
<item_count>8</item_count>
collection of network <item_count_total>8</item_count_total>
<item_offset>0</item_offset>
architecture principles which <request_process_time>0.0728</request_process_time>
outline how resources are <request_query_count>55</request_query_count>
<request_result>success</request_result>
deﬁned and addressed. <request_result_description></
request_result_description>

• REST is a Client-server, <request_result_id>601</request_result_id>
<request_uri>[GET] asset?
Stateless, Cacheable and limit=10&user_id=admin&is_app_admin=TRUE</
request_uri>
Layered protocol. <vpx_version>1.7.3</vpx_version>
</header>
<items>
✓ This reduces the complexity <item id="1">
<asset_id>ZG3SmyybQ61abezpbVHrJkFF</asset_id>
✓ improves the effectiveness of ..... etc
performance tuning
✓ increases the scalability of pure
server components


Features
flexible

Flexible Metadata
metadat
a sets

Element Sets
Metadata Element Sets Provided:
• Standard Dublin Core (DC)
• Qualified Dublin Core (QDC)
• Learning Object Metadata (IEEE LOM)
• ‘Content Zoek Profiel’ (CZP)
Plus support for own (custom) Metadata Element Sets

CRUD REST-calls on all objects possible. i.e.:
• POST /asset/create?user=John
• GET /asset/$asset_id
• POST /mediafile/$mediafile?filename=NewName
• POST /collection/$coll_id/delete?user=John


Features
ﬂexible
transcod
ing serv
ices

Transcoding Services

Based on FFMPEG a complete, cross-platform solution to record, convert and stream
audio and video. It includes libavcodec - the leading audio/video codec library.


For (stre
aming) vi

VP-Core
deo, aud
io and in
content fact any

• Shared platform SURFnet and Kennisnet
• Application, streaming-, transcoding servers + storage
• Powered by MediaMosa


For build
and med ing an online de
ia manag liv
ement p ery

Webservices
latform

Over 150, divided in services for....

• Play Video (PlayProxy HTML wrapper)
• Authentication (DBUS for EUA)
• Authorization
(Domain, REALM, Group or mixed)
• Upload (PUT, POST, FTP)
• Transcoding
• Media Management: mediaﬁles, assets
and collections
• Search: Contextual Query Language
• Jobs
• Metadata and OAI/PMH
• Notiﬁcation
• Logging and Statistics


Search Services
Simple Search:
• GET /asset?owner=John
• GET /asset?collection=7
Advanced Search using CQL level 2 :
• “(dc.title = foo OR qdc.title_alternative = bar)”
• “NOT (dc.title = foo AND dc.title = bar)”
• “^cat ^dog tree^”
http://www.loc.gov/standards/sru/specs/cql.html


Access Management
‘Screening’
Default: Media is accessible for everyone.
Option to set access restrictions for playing media on the
following properties:

• Domain, i.e only accessible from surfnet.nl
• Groups of domains, i.e.: Academia group (all universities)
• Realm, i.e. using ASelect, Entree, DigiD, SURFfederation
• Groups of Realms, i.e.: '@teleblik' realm
• User: only give rights to user=john
• Groups of users, i.e.: only give rights
to users of group "class-24".

Combinations of the above are
possible! De end-user application
designer decides how and what to
use.


Upload Services
• POST upload using End User Application
(limited to 2 GB)

• POST upload directly to MediaMosa Platform
using ticket system (limited to 2 GB)

• HTTP PUT upload using End User Application
(i.e. Java Upload Applet)

• FTP batch upload (“no” limits) including
metadata in XML ﬁle

• Quota per End User Application
• Support for Master / Slave content sharing MediaMosa
(Provider Application / CLA)


End-user Application
Web frontend for media distribution.
SURFnet: SURFmedia
Kennisnet: Teleblik


SURFnet: SURFmedia
Kennisnet: Teleblik

Video backend infrastructure
including streaming- and transcoding servers
and storage.
SURFnet/Kennisnet: VP-Core


SURFnet: SURFmedia
Kennisnet: Teleblik

and storage.

Support Applications
White Label EGA, Provider Application and
OAI Provider / Harvester


SURFnet: SURFmedia
Kennisnet: Teleblik

and storage.

Support Applications
White Label EGA, Provider Application and
OAI Provider / Harvester

Powered by MediaMosa:
open source application
for media management and distribution


MediaMosa Community

Com munity


MediaMosa Community

Com munity

http://mediamosa.org

• Code repository Subversion (SVN)
• Community Forum
• Documentation
• Issue Tracker
• Online Reference Guide
• Wiki
• Projects:
MediaMosa Building Block for Blackboard
RichMedia EGA for viewing weblecture recordings

Open access
English language
http://mediamosa.org

MediaMosa Directions
WWW
http://mediamosa.org/
osa
MediaM
Forum MediaMosa
http://mediamosa.org/forum MediaMosa

Lists
announce@lists.mediamosa.org
devel@lists.mediamosa.org
trac@lists.mediamosa.org

Issue Tracker
http://mediamosa.org/trac

Subversion (SVN)
http://mediamosa.org/trac/browser


MediaMosa Status & Roadmap
Available on
mediamosa.org
Release 2.2

Continued Development:
2010: Three major releases based on new Drupal 7 framework
Focus to provide a better and more supported community version for
open source development

Technology Scouting Projects:
• Rich Media - Weblecture recording support
• Transcripting Technology Scout
• MediaMosa Open API / Cloud
• Enhanced support for other content than audio/video


New Community Website & Online DEMO


MediaMosa DEMO


MEDIAMOSA IN RELATION WITH TECHNOLOGY SCOUTING
& WEBLECTURE RECORDING PROJECTS


TECHNOLOGY SCOUTING PROJECTS... PAST & PRESENT

• Rich Media Systems Compared • Content in the Cloud
• MediaMosa Building Block for • MediaMosa and Open Webservices
Blackboard • Transcipting Technology
• MediaMosa and support for other • Open Live Streaming
content
• MediaMosa RichMedia EUA
• Full text search engines • Content Supplier Application

Sco uts
ediaMosa Technology
M


RICH MEDIA / WEBLECTURE RECORDING SYSTEM 1:
MEDIASITE

http://www.sonicfoundry.com/mediasite/


PRESENTATIONS2GO

http://www.presentations2go.eu/

APPLE’S PODCAST PRODUCER & RECORDING BOX

1: Dual Mac Mini setup to capture
presenter using camera and capturing
beamer signal.

2: Recording Box backend system takes
care of metadata and synchronized start
op capture.

3: Podcast Producer cluster will encode
the streams into a single (PIP) video and
publish the result according to workﬂow
used.

4: Result will be available as a feed for
different devices and formats.



5: Using the bulkupload tool, recording is
uploaded to a MediaMosa platform and
made available in SURFmedia.

5


DEMO


MEDIAMOSA RICH MEDIA END USER APPLICATION


MEDIAMOSA RICH MEDIA END USER APPLICATION

Goal: to provide a rich media
presentation application using
MediaMosa for presenting weblecture
recordings
• Rich Media = Weblecture Recording
• 2 playback modes: Video - Video or Video -
Slides

• Using export of a MediaSite recording
• Automatically producing slides from video
• Code available on MediaMosa website:
http://www.mediamosa.org/richmedia


MEDIAMOSA AND OPEN WEBSERVICES

Goal:
1) to provide an open
interface for sharing data
stored in an MediaMosa
environment

2) to consume data from
other open platforms and
to integrate this in
MediaMosa


WHAT IS OPEN?
• Open Source (MediaMosa, FFmpeg)
• Open Codecs (h.264, theora, VP8)
• Open Media Formats (Mpeg4, ogg, WebM)
• Open Standards (HTML 5)
• Open Technology (Open API)
• Open Content (Creative Commons)
• Open Principles (Open Video Alliance)
• Open License (Royalty Free vs ‘Forever Free’)


OPEN VIDEO PRINCIPLES
OPEN VIDEO ALLIANCE

1. Authorship and Viewing

2. Open Standards for Video

3. Open Distribution

4. A Rich, Participatory Culture

5. Civil Liberties and Basic Rights

Source: http://openvideoalliance.org/


OPEN VIDEO CONTENT
CREATIVE COMMONS

The user / owner / uploader needs to
determine if and which type of CC-license


OPEN API
Technology to
:11;)<) -%"$"./15") present MediaMosa
34.(5+.16'/"'/".)
789)
content using a public
:11;)=) API
A-".)9-')
• Simple interface to data (search)
• Results in a generic format for easy
usage (atom, json, rss)
!"#$"%&'("$)
:11;)>)
• Open API uses existing webservice
2"0'12+$1) layer of MediaMosa
:11;)?) *+,-+."./".)

Content could be:
:11;)@)
01/1) 01/1) • Open Content
• Special Content Collections
(Academia)
• EndUser Aplication Content


OPEN CONTENT VS ENDUSER-APPLICATION CONTENT

MediaMosa content can EndUser Applications
always be presented using the
enduser application

➡ Additional using an Open
API
➡ Open content: most likely
content which is freely
available (not protected)
➡ If protected: use oAuth to
supply content using the MediaMosa
Open API



Open Content per EUA
Open API comparable with OAI
+,%(-( No need for access rules

/01(
!"#$%!&'%(
/2"3(
041( )%*%( )%*%(
+,%( +,%(
-( '2"5$%6"( .(
5&66"57"(



Special Content Collections
(Academia)
Need access rules
+,%(-(
/2"3(
041(

/01(
!"#$%!&'%(
)%*%( )%*%(
+,%( +,%(
-( '2"5$%6"( .(
5&66"57"(



Open API for all open
content
Needs to know which
+,%(-(
data is open
/2"3(
041(

/01(
!"#$%!&'%(
)%*%( )%*%(
+,%( +,%(
-( '2"5$%6"( .(
5&66"57"(


OAUTH
http://oauth.net/
• OAuth is an open authorization
standard for APIs that does away with
logins and passwords to grant
authorization to a third-party.
OAuth is an open protocol to allow
secure API authorization in a simple and
standard method from desktop and web
applications.
OAuth uses three parties:
client uses web service at server on behalf of user
client = mashup, server = MediaMosa open API, user = owner of video

...and a forth party: SURFfederation (authentication infrastructure)


CONSUME DATA FROM OTHER OPEN API PLATFORM

Consume data in the context of
• ... adding video’s to MediaMosa
• ... adding information to existing video
(metadata)
• ... adding different types of data to
MediaMosa (pictures, docs, ...)
• ... combine data from other sources -
Mashup Atom Publishing Protocol: AtomPub:
http://www.rfc-editor.org/rfc/rfc5023.txt


PROOF OF CONCEPTS

http://api.mediamosa.surfnet.nl/


MEDIAMOSA IN RELATION WITH OPENCAST MATTERHORN


COMMERCIAL VIDEO MANAGEMENT SYSTEMS


NON-COMMERCIAL / OPEN SOURCE
VIDEO MANAGEMENT SYSTEMS

(virtPresenter)

(Re-Collect)


NON-COMMERCIAL / OPEN SOURCE
VIDEO MANAGEMENT SYSTEMS


FACTS & FIGURES

Opencast Matterhorn MediaMosa

Version 1.0 July 2010 Version 1.0 July 2008
Version 2.0 July 2011/2012 Version 1.6 July 2009
(Start Open Source Community)
Version 2.2 Sept 2010
Annual: 3 major releases
Community ﬁrst, Product ﬁrst,
product later Community later
Educational Community GPLv2
License, Version 2.0


OPEN SOURCE LICENCES





Philosophy
To allow the maximum
use of our software for
any purpose and by all
people.




Philosophy All direct development is
To allow the maximum contributed back and
use of our software for remain under the same
any purpose and by all license.
people.
This limits commercial
adoption




Philosophy All direct development is
To allow the maximum contributed back and
use of our software for remain under the same
any purpose and by all COMPATIBLE
NOT license.
people.
This limits commercial
adoption


TECHNOLOGY

JAVA MediaMosa 1.x: Drupal 6
OSGi MediaMosa 2.x: Drupal 7
Linux/Debian/Ubuntu/Redhat
PHP
MySQL
FFMpeg
FFMpeg REST communication
REST services between frond-end and
back-end system


COMPARATIVE TABLE


HOW MEDIAMOSA AND MATTERHORN CAN CO-ACT

Feed Matterhorn capture
agents into MediaMosa
Make MediaMosa a distribution
channel in Matterhorn
Feed MediaMosa content into
Matterhorn engage end


HOW MEDIAMOSA AND MATTERHORN CAN CO-ACT

Feed Matterhorn capture
agents into MediaMosa
Make MediaMosa a distribution
channel in Matterhorn
Feed MediaMosa content into
Matterhorn engage end

Other options?


TIME TO DO ANOTHER TECHNOLOGY SCOUTING PROJECT


THE IDEA


THE TECHNOLOGY SCOUTING PROJECT

!



WO
RK IN P
ROG
R ESS

!


PHASE 1

To build a standalone
Matterhorn Capture
server and Matterhorn
backend server


PHASE 2

To develop a custom workﬂow
for delivery into MediaMosa


PHASE 3

Integration
Using the MediaMosa Open
API technology

QUESTIONS?

FRANS.WARD@SURFNET.NL

HTTP://MEDIAMOSA.ORG/


MediaMosa: overview, architecture and how it fits with Opencast Matterhorn

Recomendados

Recomendados

Mais conteúdo relacionado

Semelhante a MediaMosa: overview, architecture and how it fits with Opencast Matterhorn

Semelhante a MediaMosa: overview, architecture and how it fits with Opencast Matterhorn (20)

Mais de MediaMosa

Mais de MediaMosa (20)

Último

Último (20)

MediaMosa: overview, architecture and how it fits with Opencast Matterhorn

Notas do Editor