A Semantic Multimedia Web: Part 3 of a series of lectures given at the Universidad Politécnica de Madrid (UPM), May 2009

1. A Semantic Multimedia Web: Create, Annotate, Present and Share your Media Raphaël Troncy, < [email_address] > CWI, Interactive Information Access

5. Three ingredients Content

6. Content of example Clair-obscur (Frans) en chiaroscuro (Italiaans) betekenen 'licht-donker'. Beide termen worden gebruikt om sterke licht-donkercontrasten in schilderijen, tekeningen en prenten aan te duiden. Hoewel het effect al eerder werd toegepast, is de term pas sinds het einde van de 16de eeuw in zwang. De oorsprong van het woord ligt in Italië. De schilder Caravaggio (1573-1610) maakte het chiaroscuro-effect tot zijn handelsmerk. Hij was een meester in het schilderen van donkere taferelen met één felle lichtbundel .

7. Three ingredients Content Presentation structure

8. Presentation structure of example Clair-obscur (Frans) en chiaroscuro (Italiaans) betekenen 'licht-donker'. Beide termen worden gebruikt om sterke licht-donkercontrasten in schilderijen, tekeningen en prenten aan te duiden. Hoewel het effect al eerder werd toegepast, is de term pas sinds het einde van de 16de eeuw in zwang. De oorsprong van het woord ligt in Italië. De schilder Caravaggio (1573-1610) maakte het chiaroscuro-effect tot zijn handelsmerk. Hij was een meester in het schilderen van donkere taferelen met één felle lichtbundel . Chiaroscuro & Rembrandt Harmensz. Van Rijn description examples title

9. Three ingredients Content Presentation structure Aesthetics abcdefghij abcdefghijklmn ABCDEFGHIJK abcdefghijklm abcdefghijklm

10. Aesthetics of example Colours Fonts Layout Colours

11. Design dependencies Content Presentation structure Aesthetics abcdefghij abcdefghijk ABCDEFGHIJK abcdefghijk abcdefghijk

12. Presentation Structure depends on Layout description title title description description examples title description examples title

13. Style Depends on Content Chiaroscuro & Rembrandt The Stone Bridge (1638) Chiaroscuro & Rembrandt The Stone Bridge (1638)

14. Presentation structure depends on content Rembrandt Caravaggists chiaroscuro 1631 1628 1638 1623 1628

15. Example Presentation Structure Rembrandt Chiaroscuro Caravaggists 1631 1628 1638 1623 1628

17. Multimedia Web Tagging Semantic Web

18. Making Music Out Of The Social Noise

19. W3C Multimedia Semantics XG (2007) W3C Multimedia Semantics XG http://www.w3.org/2005/Incubator/mmsem/

22. Metadata Working Group

24. W3C Media Annotations WG (2009) http://www.w3.org/2008/WebVideo/Annotations/

29. Design interactive interfaces to explore a large heterogeneous graph Presentation @ Talis December 2008

30. Browsing Linked Data Tabulator (CSAIL, MIT)

31. Browsing Linked Data Disco (Free University of Berlin)

32. Browsing Linked Data Marbles (Free University of Berlin)

33. Browsing Linked Data Zitgist (Zitgist LLC)

34. Browsing Linked Data OpenLink Data Explorer (OpenLink Software)

36. cartoons videos

37. animations blogs

38. News Production

39. News Production: Complex & Dynamic Workflows

41. Metadata

45. News and Multimedia Formats (NAR) News Architecture NewsML G2 EventsML G2 SportsML G2

47. Building a Semantic Web Infrastructure for News 1 2 3 4 Modeling the NAR ontology Linking with media ontologies Building SKOS thesauri Enriching the metadata

48. Step 1: Modeling the NAR Ontology  focus on reuse of XML types leading to multiple repetition resulting in overly complex nested XML structures

51. Step 2: Linking with Media Ontologies foaf:Person ≈ nar:Person dc:Subject ≈ nar:Subject sioc:Item ≈ nar:Item geo:lat geo:long +

52. Step 3: Getting SKOS Vocabularies

53. Step 3: Getting SKOS Vocabularies

55. Step 4: Enriching the News Metadata NAR Ontology NewsCodes Thesaurus Named Entity Recognition Domain Ontologies

56. Step 4: Enriching the News Metadata NAR Ontology NewsCodes Thesaurus Domain Ontologies Concept Detectors

57. Web of Data and Linked Data dbpedia:Zidane foaf:depicts nar:location geonames:2950159 nar:subject nc:15054000 events:id wp:2006_FIFA_World_Cup#Final

59. Semantic Search of Multimedia News Powered by ClioPatria 1.0 alpha 3 1,067,754 Total 1,932 INA Broadcast Video (June/July 2006) 61,311 AFP Photos (June/July 2006) 804,446 AFP News Feed (June/July 2006) 53,468 DBpedia, Geonames 34,903 Thesauri: newscodes 104,358 Domain Specific Ontologies: football 7,336 General Ontologies: NAR, DC, FOAF Number of RDF Triples Description

61. Provide new dimensions for browsing Distinguish field images vs stadium and street images with a grass detector for the World Cup dataset

67. ABC Event Model

68. CIDOC CRM Event Model

69. CultureSampo Event Model

70. Framenet Event Model

71. Motools Event Model

72. Towards an Linked Events Model?

74. Configuring Semantic Web Interfaces by Data Mapping Presentation @ VISSW Visual Interfaces to the Social and the Semantic Web February 2009

76. Assignment (follow-up)

79. Thanks for your attention http:// www.cwi.nl/~troncy