The Media Ecology Project: Using Linked Data to Support Distributed Analysis of Visual Culture

•

1 gostou•1,732 visualizações

The Media Ecology Project (MEP) is an architecture, methodology, and partnership network that facilitates new forms of scholarly production based on distributed analysis of moving image materials. Based on standards like the W3C Open Annotation Data Model, MEP seeks to connect a variety of specialized tools together using a third-party metadata repository that sits outside of any single tool or video archive. Doing so serves several purposes: it allows existing software platforms to be used in a more open, collaborative manner; it maintains the ability of individual tools to specialize in focused areas of functionality without the pressure to serve all needs for all users; and it frees metadata created for a specific analysis to be shared with other scholars. A critical outcome of this model is that it allows metadata created by subject area experts outside of source archives to contribute metadata they generate about an asset back to the archive itself, expanding the archive's contextual knowledge about its own materials. The first stand-alone tool developed for MEP, Ono-my.org, is available now at http://onomy.org/ . This is a presentation from the LIME workshop at ESWC 2014.

Dados e análise Educação Tecnologia

Using Linked Data

to Support Distributed Analysis

of Visual Culture
John Bell • john.p.bell@maine.edu

Mark J Williams • mark.j.williams@dartmouth.edu

CURRENT MODEL
• User clicks MediaThread bookmarklet
on Library of Congress video

• MediaThread bookmarklet scrapes
metadata from Library of Congress
and stores it in MediaThread’s local
database

SIDELOADED METADATA
• MediaThread sends a second request
to MEP for any metadata about the
video, then adds the result to its
database

• The user never knows MEP was
queried

ADDED METADATA
• User adds annotations, commentary,
tags, etc. to the video in MediaThread

• When the user publishes their work,
MediaThread sends the user’s new
metadata to MEP

ADDED METADATA
• The user’s metadata is added to what
MEP knows about the video and what
it sends to MediaThread next time
that video is loaded

• If the Library of Congress can accept
the new metadata, MEP will send it
back to enhance the original source’s
records

COMMENTARY
Commentary

A woman can be seen rolling out a pie crust in the center of a table on a set of a kitchen.A pie is cooling
on the sideboard.As the woman continues her work, the door opens and a big man dressed as a tattered
tramp enters and gestures a request for food.The woman replies by hitting him with a rolling pin, knocking
him to the ﬂoor.
<rdf:Description rdf:about="http://mep.dartmouth.edu/users/john-bell/annotation">

<rdf:type rdf:resource="http://scalar.usc.edu/2012/01/scalar-ns#Composite"/>

<dcterms:title>TheTramp and the Muscular Cook</dcterms:title>

<dcterms:description></dcterms:description>

<sioc:content> A woman can be seen rolling out a pie crust in the center of a table on a set of a kitchen.A pie is cooling on

the sideboard.As the woman continues her work, the door opens and a big man dressed as a tattered tramp
enters and gestures a request for food.The woman replies by hitting him with a rolling pin, knocking him to
the ﬂoor.

</sioc:content>

<dcterms:isVersionOf rdf:resource="http://mep.dartmouth.edu/users/john-bell/annotation.0"/>

</rdf:Description>

PROVENANCE ANDTRUST
Users

*Kemp Niver, Motion Pictures from the Library of Congress Paper Print Collection 1894-1912, 1967
<rdf:Description rdf:about="http://mep.dartmouth.edu/user/ur1617546/">

<foaf:name>Kemp Niver</foaf:name>

<foaf:mbox_sha1sum>b56d0fa3ea6bc6760d50c08918ffbcdf623cf716</foaf:mbox_sha1sum>

<foaf:homepage rdf:resource="http://mep.dartmouth.edu/user/ur1617546/"/>

<rdf:type rdf:resource="http://xmlns.com/foaf/0.1/Person"/>

</rdf:Description>

CONTROLLEDVOCABULARIES
Tagging

Mutoscope, silent, rolling pin
<rdf:Description rdf:nodeID="tag-Mutoscope">

<foaf:name>Mutoscope</foaf:name>

<foaf:page rdf:resource=“http://onomy.org/published/12/term/4"/>

<rdf:type rdf:resource="http://xmlns.com/foaf/0.1/SemanticTag"/>

</rdf:Description>

<rdf:Description rdf:nodeID="tag-rolling-pin">

<foaf:name>rolling pin</foaf:name>

<foaf:page rdf:resource=“http://onomy.org/published/298/term/64“/>

<rdf:type rdf:resource="http://xmlns.com/foaf/0.1/SemanticTag"/>

</rdf:Description>

Mais conteúdo relacionado

Mais de LinkedTV

The LinkedTV architecture lays the foundation for the LinkedTV system. It consists of the integrating platform for the end-to-end functionality, the backend components and the supporting client components. Since the architecture of a software system has a fundamental impact on quality attributes, it is important to evaluate its design. The document at hand reports on the validation of the LinkedTV architecture.

LinkedTV Deliverable 5.7 - Validation of the LinkedTV Architecture

LinkedTV

This deliverable covers all the aspects of evaluation of the overall LinkedTV personalization workflow, as well as re-evaluations of techniques where newer technology and / or algorithmic capacity offer new insight into the general performance. The implicit contextualized personalization workflow, the implicit uncontextualized workflow in the premises of the final LinkedTV application, the advances in context tracking given new technologies emerged and the outlook of video recommendation beyond LinkedTV is measured and analyzed in this document.

LinkedTV Deliverable 4.7 - Contextualisation and personalisation evaluation a...

LinkedTV

This document presents guidelines on how to setup enriched video experiences. We provide user-centric guidelines on the named entities that should be detected and selected to effectively enrich video news broadcasts. This is presented in the form of a user study. We selected 5 news videos and manually extracted the candidate entities from various sources, such as the transcript, visual content and related articles. An expert was asked to also provide interesting entities for the videos. The resulting 99 candidate entities were presented to 50 participants via an online survey. The participants rated the level of interestingness of the entities and the usefulness of information from Wikipedia about these entities. Analysis of the results shows that users prefer entities of the type organization and person and have little interest for entities of the type location. They also indicate that subtitles are not enough as a source of interesting entities and that the amount of interesting entities can be improved by the combined use of subtitles with entities extracted from related articles or entities suggested by an expert. The expert suggestions showed to be more accurate than any other source of entities. Wikipedia seems to be a suitable source of additional information about the entities in the news, but should be complemented with additional sources. We provide engineering guidelines on how to present, aggregate and process content for TV program companion applications. We describe the content processing pipeline that was developed in WP3 to feed the content for the LinkedNews and Linked Culture demonstrators. This shows how content from the Web can be re-purposed to enrich videos by extracting the core display content and presenting it in a uniform way to the user.

LinkedTV Deliverable 3.8 - Design guideline document for concept-based presen...

LinkedTV

This deliverable presents the evaluation of content annotation and content enrichment systems that are part of the final tool set developed within the LinkedTV consortium. The evaluations were performed on both the Linked News and Linked Culture trial content, as well as on other content annotated for this purpose. The evaluation spans three languages: German (Linked News), Dutch (Linked Culture) and English. Selected algorithms and tools were also subject to benchmarking in two international contests: MediaEval 2014 and TAC’14. Additionally, the Microposts 2015 NEEL Challenge is being organized with the support of LinkedTV.

LinkedTV Deliverable 2.7 - Final Linked Media Layer and Evaluation

LinkedTV

This deliverable describes the conducted evaluation activities for assessing the performance of a number of developed methods for intelligent hypervideo analysis and the usability of the implemented Editor Tool for supporting video annotation and enrichment. Based on the performance evaluations reported in D1.4 regarding a set of LinkedTV analysis components, we extended our experiments for assessing the effectiveness of newer versions of these methods as well as of entirely new techniques, concerning the accuracy and the time efficiency of the analysis. For this purpose, in-house experiments and participations at international benchmarking activities were made, and the outcomes are reported in this deliverable. Moreover, we present the results of user trials regarding the developed Editor Tool, where groups of experts assessed its usability and the supported functionalities, and evaluated the usefulness and the accuracy of the implemented video segmentation approaches based on the analysis requirements of the LinkedTV scenarios. By this deliverable we complete the reporting of WP1 evaluations that aimed to assess the efficiency of the developed multimedia analysis methods throughout the project, according to the analysis requirements of the LinkedTV scenarios.

LinkedTV Deliverable 1.6 - Intelligent hypervideo analysis evaluation, final ...

LinkedTV

The LinkedTV media player and API has evolved from a single player and limited API in version 1 to a toolkit to allow rapid development and creation of different kind of applications within the HTML5 / multiscreen space. The main reason for this transition is that during the course of the Linked TV project different partners had different requirements for their scenarios. Instead of trying to fit all these requirements into one player and, most likely, compromise on the functionalities of the scenarios we wanted to offer something that would allow all partners a satisfiable solution. Therefore the Springfield Multiscreen Toolkit, or short SMT, has been developed. The aim for the SMT was to allow flexibility for developing multiscreen applications. Also from a commercial point of view a toolkit with examples is more interesting than a pure player as it gives the freedom of developing new ideas with the LinkedTV platform.

LinkedTV Deliverable 5.5 - LinkedTV front-end: video player and MediaCanvas A...

LinkedTV

LinkedTV - an added value enrichment solution for AV content providers

LinkedTV

LinkedTV tools for Linked Media applications (LIME 2015 workshop talk)

LinkedTV

LinkedTV Newsletter (2015 edition)

LinkedTV

LinkedTV Deliverable D4.6 Contextualisation solution and implementation

LinkedTV

This report describes the LinkedTV user interfaces. Based on the results user studies and the initial evaluation of the year 2 prototype we selected and refined the interfaces. We selected a single screen application that uses HbbTV technology to provide additional information about a TV program as an overlay on the TV broadcast. In addition, we worked towards TV program companion applications that are tailored for two domains: news and cultural heritage. With these applications we demonstrate different types of interaction modes, such as synchronized content on a second screen, and bookmarking chapters combined with the exploration of related content after the program. The interfaces are built on top of the Multiscreen Toolkit. We created a component-based infrastructure that allows us to quickly create tailored companion applications by reusing and configuring interface components. In the final part of the project we finalize this approach and test it by applying it to a new domain.

LinkedTV Deliverable D3.7 User Interfaces selected and refined (version 2)

LinkedTV

This deliverable describes the final LinkedTV framework that provides a set of possible enrichment resources for seed video content using techniques such as text and web mining, information extraction and information retrieval technologies. The enrichment content is obtained from four type of sources: a) by crawling and indexing web sites described in a white list specified by the content partners, b) by querying the API or SPARQL endpoint of the Europeana digital library network which is publicly exposed, c) by querying multiple social networking APIs, d) by hyperlinking to other parts of TV programs within the same collection using a Solr index. This deliverable also describes an additional content annotation functionality, namely labelling enrichment (as well as seed) content with thematic topics, as well as the process of exposing content annotations to this module and to the filtering services of LinkedTV’s personalization workflow. We illustrate the enrichment workflow for the two main scenarios of LinkedTV which have lead to the development of the LinkedCulture and LinkedNews applications, which respectively use the TVEnricher and TVNewsEnricher enrichment services. The original title of this deliverable from the DoW was Advanced concept labelling by complementary Web mining.

LinkedTV Deliverable D2.6 LinkedTV Framework for Generating Video Enrichments...

LinkedTV

This document reports on the design and implementation of the final version of the editor tool (ET) v2.0, where its purpose is to serve the program editing teams of broadcasters that have adopted LinkedTV’s interactive television solution into their workflow. Two of these teams are currently represented in the LinkedTV project, namely the RBB team and the AVROTROS team (formerly known as AVRO). The main purpose of the ET is to provide a means to correct and curate automatically generated annotations and hyperlinks created by the audiovisual and textual analysis technologies developed in WP 1 and 2 of the LinkedTV project. Without the intervention of human editors to correct this data, there is a reasonable risk of exposing inappropriate, incorrect or irrelevant information to the viewers of a LinkedTV interactive broadcast.

LinkedTV Deliverable D1.5 The Editor Tool, final release

LinkedTV

Having extensively evaluated the performance of the technologies included in the first release of WP1 multimedia analysis tools, using content from the LinkedTV scenarios and by participating in international benchmarking activities, concrete decisions regarding the appropriateness and the importance of each individual method or combination of methods were made, which, combined with an updated list of information needs for each scenario, led to a new set of analysis requirements that had to be addressed through the release of the final set of analysis techniques of WP1. To this end, coordinated efforts on three directions, including (a) the improvement of a number of methods in terms of accuracy and time efficiency, (b) the development of new technologies and (c) the definition of synergies between methods for obtaining new types of information via multimodal processing, resulted in the final bunch of multimedia analysis methods for video hyperlinking. Moreover, the different developed analysis modules have been integrated into a web-based infrastructure, allowing the fully automatic linking of the multitude of WP1 technologies and the overall LinkedTV platform.

LinkedTV Deliverable D1.4 Visual, text and audio information analysis for hyp...

LinkedTV

D8.6 presents the results of the market analysis for LinkedTV products and services and consists of two parts: an overall analysis of current and future developments in the TV and digital video market and a specific market analysis of potential LinkedTV customers and competitors. Based on the market analysis it was possible to provide a first rough estimation of the LinkedTV market potential and to position LinkedTV on the market.

LinkedTV D8.6 Market and Product Survey for LinkedTV Services and Technology

LinkedTV

This deliverable presents the LinkedTV Public Demonstrator which will be an online, publicly accessible Website collecting showcases of the key project outputs which form together our LinkedTV solution: the Editor Tool, Platform and Player, complemented by demonstrations of the provision of this solution for the content of two European broadcasters: the LinkedCulture and LinkedNews scenario demonstrators.

LinkedTV D7.6 Project Demonstrator v2

LinkedTV

LinkedTV D7.5 LinkedTV Dissemination and Standardisation Report v2

LinkedTV

User trials were prepared and conducted in the first quarter of 2014 in order to assess the appropriateness of the innovative functionalities of the second screen demonstrator developed in Y2 of the LinkedTV project. A sample installation of LinkedTV was set up at three different locations: at Rundfunk Berlin Brandenburg (RBB), Sound & Vision (S&V), and at the University of St. Gallen (USG). The LinkedTV installation included a TV showing sample content (“main screen”) and an tablet (“second screen”) showing chapters of the program as well as semi-automaticaly acquired additional information about persons, topics and places depicted in the program on the main screen. In total 24 participants took part in the trial at all three locations (9 at RBB, 5 at S&V and 10 at USG). To assess the appropriateness of the LinkedTV features, the trial participants were provided with a “hands-on” opportunity to use the LinkedTV Application and were observed while using the installation. The participants also filled in a questionnaire at the end of the session.

LinkedTV Deliverable D6.3 User Trial Results

LinkedTV

LinkedTV Deliverable D5.6 Final LinkedTV End-to-End Platform

LinkedTV

This deliverable describes the final LinkedTV scenario demonstrators, which have been implemented with the most recent versions of the LinkedTV technology set. The demonstrators use real broadcaster TV programming (news from RBB and cultural heritage from AVRO) and show the benefits of LinkedTV through providing seamless access during the programme to related information and content from the Internet. They also validate the maturity of the LinkedTV technologies which were used to implement the scenario demonstrators.

LinkedTV D6.4 Scenario Demonstrators v2

LinkedTV

Mais de LinkedTV (20)