Mobile multimedia services are in high demand, but their development comes at high costs. The emergent computing paradigm cloud computing has great potential to embrace these issues. In fact, we are at the early stage of the coalescence of cloud computing, mobile multimedia and the Web. Motivated by the tremendous success story of the Web based on its simplicity principles, we argue for a comprehensive review on current practices of web and mobile multimedia cloud computing techniques for avoiding frictions. We draw on experience from the development of advanced collaborative multimedia web applications utilizing multimedia metadata standards like MPEG-7 and real-time communication protocols like XMPP. We propose our i5CLoud, a hybrid cloud architecture, which serves as a substrate for scalable and fast time-to-market mobile multimedia services. This paper demonstrates the applicability of emerging cloud computing concepts for mobile multimedia.

1. MMC Workshop on
Multimedia on the Web
Mobile Multimedia Cloud Computing
and the Web
Dejan Kovachev, Yiwei Cao & Ralf Klamma
September 8th, 2011
Informatik 5 (Information Systems), RWTH Aachen University
&
Bonn-Aachen International Center for Applied Information Technology
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-1
Graz, Austria

2. Motivation



“By 2013, mobile phones will surpass PCs as the way most
people hop onto the Web” [Gartner report 2010]
“…two-thirds of the world's mobile data traffic will be video
by 2015” [Cisco Visual Networking Index 2010]
Mobile and web networks converge
– Asymmetry in multimedia material production and consumption

User/Community/Social Computing
– Movement from business-oriented to user/community-centric
applications

Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-2
Increased exploration of the potential of cloud computing by
organizations and individuals

3. Agenda
Motivation
 Experiences from previous works
 Perspectives on mobile multimedia cloud computing

– Technology
– Mobile multimedia
– User and community perspective
I5 Multimedia cloud architecture
 Use cases
 Discussion and future work

Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-3

4. Previous works:
LAS Server & Applications

Lightweight Application Server (LAS) [Spaniol et al. 2006]
– Community Middleware
– Platform for (Web-)Services
– Currently: ~30 Services
– E.g.: Usermanager, MPEG-7 Services

Applications using LAS:
–
–
–
–
–
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-4

YouTell (Web)
SeViAnno (Web)
AnViAnno (Android)
Mobile Campfire (iPhone)
NMV (Desktop)
More recently: LAS XMPP Extension

5. Previous works:
SeViAnno

Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-5
Interactive semantic annotation of videos [Cao et al. 2010]

6. Experiences from Building
Multimedia Web Applications

Design and implementation of alternative architecture
Factors
Next-generation Mobile Web Services
Performance
Low response time independent of requests
Scalability
Scalable and distributed access to services
Development cost Enabling of a single person to design and run web-scale
multimedia applications
Availability
Available services from anywhere at anytime
Interoperability
Various mobile platforms
Protocols and
Cloud-based multimedia framework using emerging protocols
standards
and standards like XMPP and HTML5
Reduced data
Improved mobile multimedia service quality
communication
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-6

7. Mobile Multimedia Cloud Computing:
Technology Perspective

Data management
– Big data and NoSQL cloud storage for multimedia artifacts
– Amazon S3, Google BigTable, Hadoop HBase
– Traditional relational DBMS for metadata storage

Communication
– The mobile broadband Internet offers improved QoE,
more interactive applications
– Protocols like XMPP or SIP offer integrated social structures application-level
routing, resource discovery, extensibility, etc.

Computation
– Client server model and Web Services
– Automatic offloading of computation tasks into the cloud
or using nearby resources (home servers, base stations, kiosks)
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-7

8. Mobile Multimedia Perspective

Multimedia formats and transcoding
– Interoperability and adaptation via transcoding
services for different platforms

Multimedia semantics
– Analysis of low-level features

Multimedia modeling
– Multimedia context
(coming from the multimedia semantics)
– Mobile context inferred using sensors on devices
– Metadata standards and ontologies for knowledge
representation and processing
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-8

9. User and Community Perspective

Sharing and collaboration
– Driving force for mobile devices improvement

Ubiquitous multimedia services
– Accessibility on heterogeneous mobile
and desktop devices
– Seamless multimedia experience

Privacy and security
– Holistic trust models of devices, applications,
communication channels and cloud service providers
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-9

10. I5 Multimedia Cloud Architecture
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-10

11. I5 Cloud Resource Usage Monitoring
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-11

12. Use Case: Collaborative Metadata
Management and Multimedia Sharing
XMPP is the main communication protocol to
support real-time collaboration
1- images and videos
2- tag basic metadata
Documentation
Expert
Architecture
Expert
Metadata
Captured
time
Taken
location
Creation
time
Provenance
….
Local
Workforce
Collaborative
Multimedia Cloud
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-12
Historian
Third party
Metadata
Repository

13. Use Case:
Mobile and Web Video Integration
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-13

14. Use Case: Improving UX of Mobile
Video Media Using Cloud Services
 Mobile video browsing tedious
- Only time point as position clue
- Takes long time until preview image
available
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-14
 Improvement of mobile
video browsing
- Segment-dependent
- Metadata-dependent
Improving user experience for mobile video by intelligent and fast video
processing cloud services

15. Discussion


Mobile networks are part of the Web now
Augmentation of resource-poor mobile devices through cloud services
Perspective
Technology
Multi-platform video transcoding, MPEG-7 based metadata,
intelligent video adaptation
User/Community
I5-KCKl-0911-15
XMPP, Video streaming, Deltacloud API
Mobile multimedia
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
Use cases’ features
Enhanced mobile video UX, collaborative multimedia services via
metadata creation and sharing in real-time

16. Future Work

The XMPP protocol for metadata synchronization as XEP
extension
– Real-time collaboration and sharing of XML documents (i.e.
metadata documents)

Interoperability between MPEG-7 and other metadata
standards
– W3C Media Annotations Ontology and API

Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-16
Three-tier cyber-foraging using offloading to nearby
(cloudlet) and remote resources (cloud)
– Reduced latency – better interactivity
– Goal-Cost-Metrics based model for resources scheduling

17. Feedback? Questions?
Thank You!
kovachev@dbis.rwth-aachen.de
@dkovachev
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-17