MediaMosa as a Mass-storage Solution - 11 december 2013, Brussels
1. The Challenge of Mass-storage
•
The MediaMosa Foundation
MediaMosa as a Mass-storage Solution
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
2. About SURFnet
• Development and exploitation of
- the Dutch National Network for
Higher Education and Research
- innovative ICT platforms & services
- Over 14,000 km dark fiber
• By and for the Dutch Higher
Education and Research
community
- 180+ connected organisations,
serving 1 million users
- Not for profit, 86 employees
- In business since 1988
25th Anniversary!
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!2
3. SURFnet’s history of streaming activities
1998
!
2003
!
2005
!
2007
!
!
Audio & Video hosting service (FTP) - 1st gen.
SURFnet Video Portal (SVP) - 2nd gen.
SURFnet-TV Live Netcasting
Start new generation video services - 3rd gen.
SURFnet/Kennisnet innovation program
2007:
Start of open source based innovation
!
SURFmedia (2007)
VP-X Project (2007)
VP-Core Platform (2008)
MediaMosa Software (2009)
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!3
5. Digital Asset Management System
Store
Prepare
Retrieve
Share
Any Digital Asset
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!5
6. Digital Asset Management System
Store
‣
Store Any Digital Asset
‣
Describe asset using
Metadata Standards
existing standards or custom sets
‣
Access Control to Protect
Private Assets
‣
Upload, Ingest, Harvest,
SFTP, ...
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!6
7. Digital Asset Management System
Prepare
‣ Transcode video / audio / images
Mobile compatible, high/low quality, …
‣ Analyse files
Create Still, Speech2text, OCR, …
‣ Index files and metadata
Full-text, read technical metadata (id3, exif, ...)
!
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!7
8. Digital Asset Management System
Retrieve
‣
CQL
Contextual Query Language
A formal language for representing
queries to information retrieval systems
‣
Apache SOLR for indexing
and searching
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!8
9. Digital Asset Management System
Share / Play
‣
Authenticate Play Requests
‣
Serve Complete Player or Files
‣
Stream over HTTP progressive
download
Or add a streaming server to your setup
‣
Combine Multiple files per assets
for advanced functionality
‣
OAI-PMH provisioning
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!9
10. REST based SOA
✓ Flexibility by combining components
✓ Open source and using open source components
✓ Scalable for future expansion
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!10
11. Open & Public from the start
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!11
13. Transcription Technology Project
Web lecture
recording
App
Transcription
by Spraak
• Recording of Teacher
• Recording of Slides
• Reference material
MediaMosa
Multi-Source
Player
• Recognize the Speech • Transcode into audio • Enhanced Search
• Store all into an asset • Optional Subtitles
• Produce time-coded
• Mashup info
Transcript
• CMU Sphinx for English
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!13
15. The Challenge of Mass-Storage
‣ Cost considerations
‣ Indexing and Searching options
‣ Open standards and formats
‣ Migration paths
‣ Scalability
‣ Long term storage for archival
purposes
‣ Accessibility
‣ Sharing and access control
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!15
16. MediaMosa Storage Solutions
‣ Hosted on Open Source stack
‣ Storage on both Open Source
and commercial solutions
‣ Use any storage mount points
‣ Build Petabyte scale solutions
using Ceph, Glustre, MooseFS
etc.
‣ Use cloud provided solutions like
Amazon S3
Or use MediaMosa-as-a-Service:
MediaSalsa http://www.mediasalsa.eu
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!16
17. Some Use Cases
‣ Video websites
Specific topics, freemium model
‣ MOOCs & e-Learning
Build your own or integrate with existing
tools
‣ Centralised media repository
Create once, publish everywhere
‣ Archival
Well described data on flexible storage
mount points
!
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!17
18. Open Source is....
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!18
19. Open Source is....
“The realisation of an
open source
project does not guarantee
the creation
of a community”
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!19
20. Why a foundation?
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!20
28. Call to Action
‣
‣
‣
‣
‣
‣
‣
Join the community
Talk to us
Will do BoF sessions to go into specifics
Contribute
Become a sponsor
Use MediaMosa and tell us about it
Have fun
http://foundation.mediamosa.org
<board@mediamosa.org>
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!28
29. MediaMosa Directions and Q&A
WWW
http://mediamosa.org
http://foundation.mediamosa.org
!
Twitter
http://twitter.com/mediamosa
!
Online Demo
http://demo.mediamosa.org
Source Code
https://github.com/mediamosa
!
Slideshare
http://www.slideshare.net/mediamosa
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!29
30. For a
sustainable
future...
Frans.Ward@surfnet.nl
Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium
!30