slides for yH talk @ ICT.OPEN2013 (Intelligent Systems track)

1. Gaza War
Britches
World War II
Berlin Wall
Woodstock
1950
1900
1910
1970
1920
9/11
Gulf War
1930
1980
1940
1950
1990
1960
BET Hiphop Awards
2000
1970
1980
2010
1990
2000
David Graus, Maria-Hendrike Peetz,
Daan Odijk, Maarten de Rijke, Ork de Rooij
2010

2. Entity Linking for a personalized timeline of historic events
•
Motivation
•
Method
•
•
Part II: Generate User Profile
•
Part III: Matching Events to User Profile
•
•
Part I: Fetch Candidate Historic Events
Part IV: Scoring & Ranking Events
Future Work

3. •
[…] To design and build innovative and robust prototypes and
demos for tools that analyse and/or integrate open web data for
educational purposes.

4. History education

6. Personalized historic timeline
Gaza War
Britches
World War II
Berlin Wall
Woodstock
1950
1900
1910
1970
1920
9/11
Gulf War
1930
1980
1940
1950
1990
1960
BET Hiphop Awards
2000
1970
1980
2010
1990
2000
2010

7. Part I: Candidate Historic Events

8. Part I: Candidate Historic Events
select
?concept
where
{
?concept
rdf:type
dbpedia-­‐owl:Event
}

9. concept
ept
rdf:type
dbpedia-­‐owl:Event

10. concept
ept
rdf:type
dbpedia-­‐owl:Event

14. Part II: User Profile
MY FACEBOOK
PROFILE
BIO
POST
POST
LIKES
POST

20. Extract Information from Facebook profile
MY FACEBOOK
PROFILE
BIO
POST
POST
LIKES
POST

21. Access Facebook profile
MY FACEBOOK
PROFILE
BIO
POST
POST
LIKES
POST
{
"id":
"1183880085",
"likes":
{
"data":
[
{
"category":
"Musician/band",
"created_time":
"2013-­‐10-­‐27T11:37:51+0
"name":
"NAS",
"id":
"113591595350795"
},
{
"category":
"Company",
"created_time":
"2013-­‐10-­‐17T07:45:36+0
"name":
"Infinibase",
"id":
"573216229380347"
},
{
"category":
"Magazine",
"created_time":
"2013-­‐10-­‐04T13:55:10+0
"name":
"New
Scientist
NL",
"id":
"369158433181445"
},

22. Extract text
attributes
•
•
•
•
•
•
{
"id":
"1183880085",
"likes":
{
"data":
[
{
"category":
"Musician/band",
"created_time":
"2013-­‐10-­‐27T11:37:51+0000",
"name":
"NAS",
"id":
"113591595350795"
},
{
"category":
"Company",
"created_time":
"2013-­‐10-­‐17T07:45:36+0000",
"name":
"Infinibase",
"id":
"573216229380347"
},
{
"category":
"Magazine",
"created_time":
"2013-­‐10-­‐04T13:55:10+0000",
"name":
"New
Scientist
NL",
"id":
"369158433181445"
},
{
"category":
"Tv
show",
"created_time":
"2010-­‐05-­‐09T01:06:27+0000",
"name":
"The
Wire",
"id":
"5991693871"
}
]
}
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Story
Omroep
Maxim
Gamer01
Breaking
Bad
AT5
Mad
Men
The
Wire
Monty
Python's
Flying
Circus
Flight
of
the
Conchords
Donnie
Darko
Flevopark
Film
Festival
Do
The
Right
Thing
A
Clockwork
Orange
Wild
Style
Princess
Mononoke
The
Fountain
Pi
Northfork
La
Haine
Zen
and
the
Art
of
Motorcycle
Maintenance
Moon
Palace
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Fountainhead
The
Wind-­‐Up
Bird
Chronicle
Wu-­‐Tang
J.Cole
NAS
Pusha
T
ASAP
Rocky
Ab-­‐Soul
Chance
The
Rapper
Cannibal
Ox
Bonobo
Aesop
Rock
Boards
Of
Canada
Jurassic
5
GREMS
Quasimoto
Strange
Journey
Volume
Three
Drop
Velvet
MODESELEKTOR
IAM
Derek
The
Onion
Imgur
De
Speld
Wu-­‐Tang

23. •
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
ASAP
Rocky
Ab-­‐Soul
Chance
The
Rapper
Cannibal
Ox
Bonobo
Aesop
Rock
Boards
Of
Canada
Jurassic
5
GREMS
Quasimoto
Strange
Journey
Volume
Three
Drop
Velvet
MODESELEKTOR
IAM
Derek
The
Onion
Imgur
De
Speld
Wu-­‐Tang
J.Cole
I
Am
Fucking
Ambivalent
About
Science
NAS
Pusha
T
ASAP
Rocky
Chrietitie
Infinibase
Marktplaatspoxc3xabzie
Jeannette
Span
:
Spelen

24. Entity Linking
•
Given a Knowledge Base
•
Link mentions of entities (or concepts) to their referent entities

25. Entity Linking
•
From Wikipedia:
•
Extract anchor texts (words used to link to Wikipedia pages)
!
!
!
!
!
!
•
For each n-gram n ↔ Wikipedia page W estimate:
•
Probability of using n-gram n to refer to Wikipedia page W

26. Entity Linking Example
Link Probability
“Nas” occurs 2475x in Wikipedia
!
is anchor
1.723x
is no anchor
752x

27. Entity Linking Example
Link Probability
“Nas” occurs 2475x in Wikipedia
!
is anchor
1723/2475
=
69,6%
is no anchor
752/2475
=
30.4%

28. Entity Linking Example
Commonness
•
Nas is used to refer to:
•
http://en.wikipedia.org/wiki/Nas
•
http://en.wikipedia.org/wiki/Naas
•
http://en.wikipedia.org/wiki/Nås
•
http://en.wikipedia.org/wiki/Nas (Ikaria)
•
http://en.wikipedia.org/wiki/Untitled Nas album

29. Entity Linking Example
Commonness
•
Nas is used to refer to:
•
http://en.wikipedia.org/wiki/Nas
14x
•
http://en.wikipedia.org/wiki/Naas
4x
•
http://en.wikipedia.org/wiki/Nås
3x
•
http://en.wikipedia.org/wiki/Nas (Ikaria)
2x
•
http://en.wikipedia.org/wiki/Untitled Nas album
2x

30. Entity Linking Example
Commonness
•
Nas is used to refer to:
•
http://en.wikipedia.org/wiki/Nas
14/25 =
56%
•
http://en.wikipedia.org/wiki/Naas
4/25 =
1.6%
•
http://en.wikipedia.org/wiki/Nås
3/25 =
1.2%
•
http://en.wikipedia.org/wiki/Nas (Ikaria)
2/25 =
0.8%
•
http://en.wikipedia.org/wiki/Untitled Nas album
2/25 =
0.8%

31. {
"text":
"Nas",
"links":
[
{
"senseProbability":
0.726027397260274,
"title":
"Nas",
"url":
"http://en.wikipedia.org/wiki/Nas"
},
{
"senseProbability":
0.125,
"title":
"Naas",
"url":
"http://en.wikipedia.org/wiki/Naas"
},
{
"senseProbability":
0.1111111111111111,
"title":
"Nås",
"url":
"http://en.wikipedia.org/wiki/N%C3%A5s"
},
{
"senseProbability":
0.0006523157208088715,
"title":
"Nas
(Ikaria)",
"url":
"http://en.wikipedia.org/wiki/Nas%20%28Ikaria%29"
},
{
"senseProbability":
0.0006523157208088715,
"title":
"Untitled
Nas
album",
"url":
"http://en.wikipedia.org/wiki/Untitled%20Nas%20album"
}
}

32. •
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
AT5
Mad
Men
The
Wire
Monty
Python's
Flying
Circus
Flight
of
the
Conchords
Donnie
Darko
Flevopark
Film
Festival
Do
The
Right
Thing
A
Clockwork
Orange
Wild
Style
Princess
Mononoke
The
Fountain
Pi
Northfork
La
Haine
Zen
and
the
Art
of
Motorcycle
Maintenance
Moon
Palace
The
Fountainhead
The
Wind-­‐Up
Bird
Chronicle
Wu-­‐Tang
J.Cole

34. Match Events to Profile Entities

35. Match Events to Profile Entities

36. Map Events to Wikipedia Entities

37. Match Events to Profile Entities

38. Matching metric #1: link overlap

39. Matching metric #1: link overlap

40. U.S.
Hiphop
NAS
Kanye!
West
Jay-Z
Damian!
Marley

41. Global!
War
U.S.
U.S.
Allies
Hiphop
Axis
NAS
Kanye!
West
Jay-Z
Damian!
Marley
World!
War II

42. Global!
War
U.S.
U.S.
Allies
Hiphop
Axis
NAS
Kanye!
West
Jay-Z
Damian!
Marley
1
World!
War II

43. Global!
War
1
U.S.
World!
War II
U.S.
Allies
Hiphop
Axis
NAS
Kanye!
West
Jay-Z
Damian!
Marley
Jay-Z
Hiphop
Kanye!
West
Link
#4
51st!
Grammy!
Awards

44. Global!
War
1
U.S.
World!
War II
U.S.
Allies
Hiphop
Axis
NAS
Kanye!
West
Jay-Z
Damian!
Marley
Jay-Z
Hiphop
Kanye!
West
Link
#4
3
51st!
Grammy!
Awards

45. Matching metric #2: direct link
U.S.
Hiphop
NAS
Kanye!
West
Jay-Z
Damian!
Marley
Jay-Z
Hiphop
Kanye!
West
51st!
Grammy!
Awards

46. Matching metric #3: textual similarity
NAS
51st!
Grammy!
Awards

47. Matching metric #3: textual similarity
NAS
51st!
Grammy!
Awards

48. Matching metric #3: textual similarity
NAS
51st!
Grammy!
Awards

49. 51st!
Grammy!
Awards
World!
War II
Score: 0.74
Score: 0.35

50. Combine scores & rank events
"5043324":
{
"event_title":
"Iraq
War",
"related_entity_title":
"The
Wire",
"score":
1.0,
"event_date":
"2003-­‐03-­‐20"
},
"1376628":
{
"event_title":
"Blankets
(comics)",
"related_entity_title":
"Princess
Mononoke",
"score":
0.11465851113504691,
"event_date":
"2003-­‐07-­‐23"
},
"15694206":
{
"event_title":
"2006
LG
Hockey
Games",
"related_entity_title":
"Reimersholme",
"score":
0.3467068139664613,
"event_date":
"2006-­‐04-­‐29"
},
"4861876":
{
"event_title":
"2005
UEFA
Champions
League
Final",
"related_entity_title":
"Istanbul",
"score":
1.0,
"event_date":
"2005-­‐05-­‐25"
},
"31966809":
{
"event_title":
"63rd
Primetime
Emmy
Awards",
"related_entity_title":
"Mad
Men",
"score":
0.04039278737569369,
"event_date":
"2011-­‐09-­‐18"
},

53. Future Work
•
Log interactions
•
Interpret clicks as (implicit) feedback:
•
Click on Event: user is interested
•
No click on Event: user is not
•
Learn scoring & ranking functions

54. Thank you! Questions?
Try yourHistory:
See our poster:
http://apps.facebook.com/yourHistory
#98
!
!
!
!
David Graus
d.p.graus@uva.nl
@dvdgrs