1. MPEG-7
SHIV SHAKTI GHOSH
MSLIS 1st YEAR
Indian Statistical Institute
Bangalore Centre

2. Contents

Background

Introduction

Goal

What can MPEG-7 do?

MPEG-7 Parts

Relation between descriptor and content

MPEG-7 Main Elements/Tools

MPEG-7 vs previous MPEG activities

Conclusion

References

3. Background
Search and Retrieval of Multimedia data:
In recent years, there has been a huge increasing amount of audiovisual
data that is becoming available.

Need:
Search, retrieval, storage,reusage of the AV-data with higher level concept.
Forms of representation that allow some degree of interpretation of the
information meaning are necessary. These forms can be passed onto, or
accessed by, a device or a computer code.
The need for interoperability between devices has been recognized.

A solver:
Efficient processing tools to create description of AV material or to support
the identification or retrieval of AV documents.
One valid solution to handle this problem is MPEG-7.


4. Introduction : What is MPEG-7?

MPEG-7 is actually a standard developed by
Moving Picture Experts Group (MPEG,1988).
It was formally named as Multimedia Content
Description Interface. It is a standard for the
multimedia content data that supports
interpretation of the information, which can be
passed onto, or accessed by a device or a
computer.

5. GOAL
Allow interoperable searching, indexing, filtering
and access of multimedia content by enabling
interoperability among devices that deal with
multimedia content description.
Efficient representation of audio-visual (AV)
meta-data and Making audio-visual material
as searchable as text.

7. What can MPEG-7 do?

Increasing availability of potentially interesting audiovisual
materials makes search more difficult.The searching system
with which any type of AV material may be retrieved by
means of any type of query materials, such as video, music,
speech, etc.
Some tasks aided by MPEG-7:
Music : Play a few notes on a keyboard and get in return a list
of musical pieces containing the required tune or images
somehow matching the notes.
Voice : Using an excerpt of Jim Morrision’s voice, and getting a
list of Jim Morrision’s records, video clips where Jim Morrision
is singing or video clips where Jim Morrision is present.

8. Continued...
Archive - Generate descriptions of individual elements or the entire collection
of audio-visual content, and seamlessly exchange content and
corresponding descriptions among content owners, aggregators, and
consumers.
Multimedia program guide - Generate a customised program guide or
summary of broadcast of audio-visual content according to user’s
preference and use history.
Graphics - Draw a few lines on a screen and get in return a set of images
containing similar graphics, logos, or ideograms.

9. MPEG-7 Parts

ISO/IEC TR 15938-1 (Systems)
– The binary format for encoding MPEG-7 descriptions and the terminal
architecture.

ISO/IEC TR 15938-2 (Description Definition Language)
– The language for defining the syntax of the MPEG-7 Description Tools and
for
defining new Description Schemes.

ISO/IEC TR 15938-3 (Visual)
– The Description Tools dealing with Visual descriptions.

ISO/IEC TR 15938-4 (Audio)
– The Description Tools dealing with Audio descriptions.

10. Continued...

ISO/IEC TR 15938-5 (Multimedia Description Schemes)
– The Description Tools dealing with generic features and multimedia
descriptions.

ISO/IEC TR 15938-6 (Reference Software)
– A Software implementation of relevant parts of the MPEG-7 Standard with
normative status.

ISO/IEC TR 15938-7 (Conformance Testing)
– Guidelines and procedures for testing conformance of MPEG-7
implementations

ISO/IEC TR 15938-8 (Extraction and use of descriptions)
– Informative material (in the form of a Technical Report) about the extraction
and use of some of the Description Tools.

11. Relation between content and
description
An MPEG-7 architecture requirement is that
description must be separate from the
audiovisual content.
On the other hand there must be a relation
between the content and description.

12. Independence of description and
content

13. MPEG-7 Main Elements/Tools

Descriptor (D):
It is a representation of a feature defined
syntactically and semantically. It could be that
a unique object was described by several
descriptors.
standardized “audio only” and “visual only”
descriptors.
Eg; a time code for duration, color histograms.

15. 
Description Schemes (DS): Specify the
structure and semantics of the relations
between its components, these components
can be descriptors (D) or description schemes
(DS).
standardized description schemes for audio and
visual descriptors.
Eg; Video:temporally(limited by time) structured
scenes and shots including textual descriptors
at the scene level and color, motion, audio
amplitude descriptors at the shot level.

16. 
Description Definition Language (DDL): It provides
a standardized language to express description
schemes,based on XML a language that allows the
creation of new description schemes, and possibly,
descriptors. Also allows the extension and
modification of existing description schemes.
In addition to the above 3 tools there are system tools
that deal with binarization, synchronization, transport
and storage of descriptors. It also deals with
Intellectual Property protection.

18. Application Areas


Education
Journalism (e.g. searching speeches of person using his name, his voice
or his face)

Tourist information

Cultural services (museum, art gallery, digital library)

Entertainment (searching a game, karaoke)

Investigation services (human characteristics recognition)

Geographical information systems

Remote sensing

Surveillance (traffic control, surface transportation).

Social (Dating Service)

Film, Video and Radio archives.

19. Continued...

Digital library: Image/video catalogue, musical dictionary.

Multimedia directory services: e.g. yellow pages.

Broadcast media selection: Radio channel, TV channel.

Multimedia editing: Personalized electronic news service, media authoring.

Security services: Traffic control, production chains...

E-business: Searching process of products.

Audiovisual content production.

20. MPEG-7 v.s. previous MPEG
activities



MPEG-1,2, & 4 are designed to represent the
information itself,while MPEG-7 is meant to
represent information about theinformation.
MPEG-1,2, & 4 made content available,
MPEG-7 allows you to find the content you
need.
Also, MPEG-7 can be used independently of
the other MPEG standards.

21. Conclusion

The days have just begun for MPEG-7
standard and it shows clearly that there is lot
of fire present in it for future applications to be
developed on its basis. It promises a very
bright future for the presentation of the
multimedia as well as other Medias of
expressing the data on the computer.

22. References

http://en.wikipedia.org/wiki/MPEG-7

http://www.reelseo.com/mpeg7-metadata-content-standard/



Overview of the MPEG-7 StandardShih-Fu Chang, Thomas Sikora, and Atul Puri
Everything You Wanted to Know About MPEG-7 : Part 1Frank Nack(GMD-IPSI) ,Adam T. Lindsay(Starlab)
Introduction to MPEG-7:Guest lecture for ECE417 TSH Charlie Dagli

23. THANK YOU