SlideShare uma empresa Scribd logo
1 de 61
Baixar para ler offline
Towards Building a Cognitive System to
Fight for National College Admission Challenge
Yansong Feng
Joint work with
Kun Xu, Songfang Huang, Dongyan Zhao
Peking University
IBM China Research Lab
December 1, 2016
Feng et al. (PKU) Question Answering December 1, 2016 1 / 25
Pass the Exam: A New AI Challenge
The Todai Robot Project
National Institute of Informatics and
collaborators
National Center Test for University
Admissions ( 2016)
Entrance Exam of University of
Tokyo (2021)
Feng et al. (PKU) Question Answering December 1, 2016 2 / 25
Pass the Exam: A New AI Challenge
The Todai Robot Project
National Institute of Informatics and
collaborators
National Center Test for University
Admissions ( 2016)
Entrance Exam of University of
Tokyo (2021)
Japanese, Social Science, Math,
Physics
Feng et al. (PKU) Question Answering December 1, 2016 2 / 25
Pass the Exam: A New AI Challenge
The Todai Robot Project
National Institute of Informatics and
collaborators
National Center Test for University
Admissions ( 2016)
Entrance Exam of University of
Tokyo (2021)
Japanese, Social Science, Math,
Physics
The Project Aristo and Euclid
The Allen Institute for Artificial
Intelligence
Elementary School:
High School:
Feng et al. (PKU) Question Answering December 1, 2016 2 / 25
Pass the Exam: A New AI Challenge
The Todai Robot Project
National Institute of Informatics and
collaborators
National Center Test for University
Admissions ( 2016)
Entrance Exam of University of
Tokyo (2021)
Japanese, Social Science, Math,
Physics
The Project Aristo and Euclid
The Allen Institute for Artificial
Intelligence
Elementary School: Science and
Math
High School: Geometry
Feng et al. (PKU) Question Answering December 1, 2016 2 / 25
The GaoKao Challenge
Gaokao in China
National College Entrance Examination
Chinese, Math, English, History, Geography, Politics, Physics,
Chemistry, Biology
over 9,400,000 students in 2016
Feng et al. (PKU) Question Answering December 1, 2016 3 / 25
The GaoKao Challenge
Gaokao in China
National College Entrance Examination
Chinese, Math, English, History, Geography, Politics, Physics,
Chemistry, Biology
over 9,400,000 students in 2016
The China Gaokao Challenge
Prompt research in Artificial Intelligence
Team: national research institutes, universities and companies
Real National College Entrance Examinations
Chinese, History, Math, Geography
Feng et al. (PKU) Question Answering December 1, 2016 3 / 25
The GaoKao Challenge
Gaokao in China
National College Entrance Examination
Chinese, Math, English, History, Geography, Politics, Physics,
Chemistry, Biology
over 9,400,000 students in 2016
The China Gaokao Challenge
Prompt research in Artificial Intelligence
Team: national research institutes, universities and companies
Real National College Entrance Examinations
Chinese, History, Math, Geography
Feng et al. (PKU) Question Answering December 1, 2016 3 / 25
Is that Difficult?
Which is the correct ranking of provinces according to their
average altitutes, from highest to lowest?
Xiang, Liao, Ning
Tai, Lu, Su
Qing, Yue, Jin
Gui, Gan, Yu
Feng et al. (PKU) Question Answering December 1, 2016 4 / 25
Is that Difficult?
Which is the correct ranking of provinces according to their
average altitutes, from highest to lowest?
Xiang, Liao, Ning → Hunan, Liaoning, Ningxia
Tai, Lu, Su →Taiwan, Shandong, Jiangsu
Qing, Yue, Jin →Qinghua, Guangdong, Shanxi
Gui, Gan, Yu → Guangxi, Gansu, Henan
1 Knowledge:
short names of provinces
average altitudes of provinces
Feng et al. (PKU) Question Answering December 1, 2016 4 / 25
Is that Difficult?
Which is the correct ranking of provinces according to their
average altitutes, from highest to lowest?
Xiang, Liao, Ning → Hunan, Liaoning, Ningxia
Tai, Lu, Su →Taiwan, Shandong, Jiangsu
Qing, Yue, Jin →Qinghua, Guangdong, Shanxi
Gui, Gan, Yu → Guangxi, Gansu, Henan
1 Knowledge:
short names of provinces
average altitudes of provinces
2 Reasoning
relative comparisons of provinces’ altitude
ranking
Feng et al. (PKU) Question Answering December 1, 2016 4 / 25
Is that Difficult?
Which is the correct ranking of provinces according to their
average altitutes, from highest to lowest?
Xiang, Liao, Ning → Hunan, Liaoning, Ningxia
Tai, Lu, Su →Taiwan, Shandong, Jiangsu
Qing, Yue, Jin →Qinghua, Guangdong, Shanxi
Gui, Gan, Yu → Guangxi, Gansu, Henan
1 Knowledge:
short names of provinces
average altitudes of provinces
2 Reasoning
relative comparisons of provinces’ altitude
ranking
Not very challenging?
Feng et al. (PKU) Question Answering December 1, 2016 4 / 25
What about this one?
Missouri River Valley is an important agricultural area of the
United States. Aerial figure 1 shows the winter of the Missouri
River, where the white part is snow.
1. Why is the farmland on the peninsula shaped as circular?
their watering approach
rugged terrain
their farming approach
lack of farmland
Feng et al. (PKU) Question Answering December 1, 2016 5 / 25
What about this one?
2. Could you have a guess what is the main crop in this area?
Winter wheat
Corn
Rice
Potato
Feng et al. (PKU) Question Answering December 1, 2016 6 / 25
What about this one?
2. Could you have a guess what is the main crop in this area?
Winter wheat
Corn
Rice
Potato
1 Knowledge:
agriculture
climate
longitude and latitude
read maps and images
Feng et al. (PKU) Question Answering December 1, 2016 6 / 25
What about this one?
2. Could you have a guess what is the main crop in this area?
Winter wheat
Corn
Rice
Potato
1 Knowledge:
agriculture
climate
longitude and latitude
read maps and images
2 Reasoning
relationship among those factors
find analogies
common sense knowledge
Feng et al. (PKU) Question Answering December 1, 2016 6 / 25
What about this one?
2. Could you have a guess what is the main crop in this area?
Winter wheat
Corn
Rice
Potato
1 Knowledge:
agriculture
climate
longitude and latitude
read maps and images
2 Reasoning
relationship among those factors
find analogies
common sense knowledge
Not very challenging?
Feng et al. (PKU) Question Answering December 1, 2016 6 / 25
What We Need?
1 Solid knowledge:
every aspects about the Syllabus
2 Math
3 Reasoning:
logical inference
use common sense knowledge
textual entailment
Feng et al. (PKU) Question Answering December 1, 2016 7 / 25
What We Need?
1 Solid knowledge:
every aspects about the Syllabus
2 Math
3 Reasoning:
logical inference
use common sense knowledge
textual entailment
A practical starting point: Answering Factoid Questions with
Knowledge
Feng et al. (PKU) Question Answering December 1, 2016 7 / 25
What We Need?
1 Solid knowledge:
every aspects about the Syllabus
2 Math
3 Reasoning:
logical inference
use common sense knowledge
textual entailment
A practical starting point: Answering Factoid Questions with
Knowledge
Information Retrieval Based Question Answering
Answering Factoid Questions with Structured Knowledge Base
Answering Factoid Questions with both Structured and
Unstructured KBs
Feng et al. (PKU) Question Answering December 1, 2016 7 / 25
What We Need?
1 Solid knowledge:
every aspects about the Syllabus (Knowledge Bases)
2 Math
3 Reasoning:
logical inference
use common sense knowledge (a little bit)
textual entailment
A practical starting point: Answering Factoid Questions with
Knowledge
Information Retrieval Based Question Answering
Answering Factoid Questions with Structured Knowledge Base
Answering Factoid Questions with both Structured and
Unstructured KBs
Feng et al. (PKU) Question Answering December 1, 2016 7 / 25
The Task
What else did the director of the
movie Interstellar direct ?
fb:m.0fkf28 fb:object.type fb:film.film
fb:m.0fkf28 fb:film.film.directed_by ?x
[ ]
select ?y
?x fb:film.director.fim ?y
?y fb:object.type fb:film.film
Inception,
The Dark Knight Rises
The Dark Knight
Batman Begins
…..
Feng et al. (PKU) Question Answering December 1, 2016 8 / 25
The Task
What else did the director of the
movie Interstellar direct ?
fb:m.0fkf28 fb:object.type fb:film.film
fb:m.0fkf28 fb:film.film.directed_by ?x
[ ]
select ?y
?x fb:film.director.fim ?y
?y fb:object.type fb:film.film
Inception,
The Dark Knight Rises
The Dark Knight
Batman Begins
…..
Feng et al. (PKU) Question Answering December 1, 2016 8 / 25
Question Answering over Structured Knowledge Bases
Goal
Answer Natural Language Questions against Structured Knowledge
Bases
Feng et al. (PKU) Question Answering December 1, 2016 9 / 25
Related Work
Information Retrieval Community
Natural Language Processing Community
Semantic Parsing Based
PCCG style: (Zettlemoyer and Collins, 2005, Cai and Yates, 2013;
Kwiatkowski et al. 2013, Reddy et al., 2014)
Syntactic parsing style: (Clarke et al., 2010, Liang et al., 2011,
Berant et al. 2013, Berant and Liang, 2014, Xu et al., 2014)
Information Extraction Based
(Yao and van Durme 2014, Bao et al., 2014, Yih et al., 2015, Dong
et al., 2015)
Deep Learning, End2End style
(Bordes et al., 2014a, 2014b, Yang et al., 2014, Bordes et al.,
2015, Zhang et al., 2016 )
Feng et al. (PKU) Question Answering December 1, 2016 10 / 25
Related Work
Information Retrieval Community
Natural Language Processing Community
Semantic Parsing Based
PCCG style: (Zettlemoyer and Collins, 2005, Cai and Yates, 2013;
Kwiatkowski et al. 2013, Reddy et al., 2014)
Syntactic parsing style: (Clarke et al., 2010, Liang et al., 2011,
Berant et al. 2013, Berant and Liang, 2014, Xu et al., 2014)
Information Extraction Based
(Yao and van Durme 2014, Bao et al., 2014, Yih et al., 2015, Dong
et al., 2015)
Deep Learning, End2End style
(Bordes et al., 2014a, 2014b, Yang et al., 2014, Bordes et al.,
2015, Zhang et al., 2016 )
Feng et al. (PKU) Question Answering December 1, 2016 10 / 25
Semantic Parsing Based Methods
Challenges:
1 Convert questions into proper meaning representations
2 Ground the meaning representation into a database query
Feng et al. (PKU) Question Answering December 1, 2016 11 / 25
Semantic Parsing Based Methods
Challenges:
1 Convert questions into proper meaning representations
2 Ground the meaning representation into a database query
Previously:
1 Search space is huge
2 Difficult to adapt to other KBs
Feng et al. (PKU) Question Answering December 1, 2016 11 / 25
Motivation
1 Meaning representation should be KB-independent
[what] did the director of] [the movie] [Interstellar]else movies] [direct]
Feng et al. (PKU) Question Answering December 1, 2016 12 / 25
Motivation
1 Meaning representation should be KB-independent
[what] did the director of] [the movie] [Interstellar]else movies] [direct]
2 Separation of meaning representation and instantiation
fb:m.0fkf28 fb:object.type fb:film.film
fb:m.0fkf28 fb:film.film.directed_by ?x
[ ]
select ?y
?x fb:film.director.fim ?y
?y fb:object.type fb:film.film
ns:Interstellar dbo:type dbo:film
dbp:director ?x
[ ]
select ?y
?y
?y
ns:Interstellar
dbp:director ?x
dbo:filmdbo:type
Feng et al. (PKU) Question Answering December 1, 2016 12 / 25
Framework
what else movies did the director of the movie Interstellar direct
Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
Framework
what else movies did the director of the movie Interstellar direct
Parsing
Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
Framework
what else movies did the director of the movie Interstellar direct
Parsing
[what] did the director of] [the movie] [Interstellar]
variable relation category entity
else movies] [direct]
category relation
Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
Framework
what else movies did the director of the movie Interstellar direct
Parsing
[what] did the director of] [the movie] [Interstellar]
variable relation category entity
else movies] [direct]
category relation
Instantiation
Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
Framework
what else movies did the director of the movie Interstellar direct
Parsing
[what] did the director of] [the movie] [Interstellar]
variable relation category entity
else movies] [direct]
category relation
Instantiation
fb:m.0fkf28 fb:object.type fb:film.film
fb:m.0fkf28 fb:film.film.directed_by ?x
[ ]
select ?y
?x fb:film.director.fim ?y
?y fb:object.type fb:film.film
Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
Phrase Dependency Graph
[what] did the director of] [the movie] [Interstellar]
variable relation category entity
else movies] [direct]
category relation
Node
A phrase with a semantic label l ∈ {entity, category, variable, relation}
Edge
A predicate-argument dependency between phrases
unary predicate
binary predicate
Feng et al. (PKU) Question Answering December 1, 2016 14 / 25
Structure Prediction
Input: a natural language question
Output: a phrase dependency graph
A pipeline framework to predict the structure
1 Phrase Detection
what did the director of the movie Interstellar
variable relation category entity
else movies direct
category relation
2 Phrase Dependency Parsing
[what] did the director of] [the movie] [Interstellar]
variable relation category entity
else movies] [direct]
category relation
Feng et al. (PKU) Question Answering December 1, 2016 15 / 25
Instantiation
[what] did the director of] [the movie] [Interstellar]
variable relation category entity
else movies] [direct]
category relation
1 Converting Phrase Dependency Graph into Structured Queries
2 Instantiating Structured Query against KB
Feng et al. (PKU) Question Answering December 1, 2016 16 / 25
Applying Rules
[what] did the director of] [the movie] [Interstellar]
variable relation category entity
else movies] [direct]
category relation
variable category variablecategory
rule#1 rule#1 variablerelationrelationentity
rule#8
?y type movies type ?x
?x ?y
moviesInterstellar Interstellar
direct
the director of
[ ]
select ?y
type moviesInterstellar
?xInterstellar the director of
?x ?ydirect
?y
type movies
Feng et al. (PKU) Question Answering December 1, 2016 17 / 25
Probabilistic Model
[ ]
select ?y
type moviesInterstellar
?xInterstellar the director of
?x ?ydirect
?y
type movies
Qind
Qd
ns:Interstellar dbo:type dbo:film
dbp:director ?x
[ ]
select ?y
?y
?y
ns:Interstellar
dbp:director ?x
dbo:filmdbo:type
Q∗
d = arg max P(Qd |Qind )
P(Qd |Qind ) =
n
i=1
P(sdi
|sindi
)P(odi
|oindi
)P(pdi
|pindi
)
Feng et al. (PKU) Question Answering December 1, 2016 18 / 25
P(sdi
|sindi
)P(odi
|oindi
)
Freebase Search API ⇒ wikipedia ID ⇒ DBpedia Entity
P(pd |pind )
We construct the co-occurrence matrix from the patty relation
phrase dataset which includes 1,631,530 relation phrases
Feng et al. (PKU) Question Answering December 1, 2016 19 / 25
Results on QALDs
Question Answering over Linked Data
Processed Right Partial Recall Precision F-1
2014 40 34 6 0.71 0.72 0.72
2015 42 26 7 0.72 0.74 0.73
Feng et al. (PKU) Question Answering December 1, 2016 20 / 25
Results on QALDs
Question Answering over Linked Data
Processed Right Partial Recall Precision F-1
2014 40 34 6 0.71 0.72 0.72
2015 42 26 7 0.72 0.74 0.73
First Place in CLEF QALD 4 and 5
Feng et al. (PKU) Question Answering December 1, 2016 20 / 25
Results on QALDs
Question Answering over Linked Data
Processed Right Partial Recall Precision F-1
2014 40 34 6 0.71 0.72 0.72
2015 42 26 7 0.72 0.74 0.73
Nice for longer/complex sentences
Efficient: around 0.33 sec per sentence
Feng et al. (PKU) Question Answering December 1, 2016 20 / 25
Results on QALDs
Question Answering over Linked Data
Processed Right Partial Recall Precision F-1
2014 40 34 6 0.71 0.72 0.72
2015 42 26 7 0.72 0.74 0.73
Nice for longer/complex sentences
Efficient: around 0.33 sec per sentence
Consistent performances
0.76 of F-1 on Free917
0.41 of F-1 on WebQuestions
Feng et al. (PKU) Question Answering December 1, 2016 20 / 25
Further Improvement
Semantic interpretation for superlatives
Nile is the longest river in the world.
Keys:
the target: Nile
the comparison set: all rivers in the world
the comparison dimension: the length of a river
→/geography/river/length
the ranking order: descending
Feng et al. (PKU) Question Answering December 1, 2016 21 / 25
A Little More Extraction
For simple sentences:
Who does michael keaton play in cars
Who
michael keaton cars
Michael Keaton
The Merry Gentleman
Penthouse North
cvt1
Cars
cvt2
Chick Hicks
film
starring
starring
filmdirect direct by
ctv3
spouse_s
Caroline McWilliams
spousespouse_s
spouse
6/5/1982 from
1/29/1990
to
Marriage
type of union
character
portrayer
film
character
starring
charactercharacter
Question:
Star Graph:
Freebase Graph:
cvt3
film
actor
Leona Elizabeth Loftus George A. Douglas
parents
child
Feng et al. (PKU) Question Answering December 1, 2016 22 / 25
A Little More Extraction
For simple sentences:
Join Entitly Linking and Relation Extraction
gives 0.49 (+0.06) F1 on WebQuestions.
Feng et al. (PKU) Question Answering December 1, 2016 22 / 25
With Hybrid Knowledge Base Resources
a little bit complex...
Where should a visitor see in Germany ?
Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
With Hybrid Knowledge Base Resources
a little bit complex...
Where should a visitor see in Germany ?
What is the most popular crop during 1900s in USA ?
Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
With Hybrid Knowledge Base Resources
a little bit complex...
Where should a visitor see in Germany ?
What is the most popular crop during 1900s in USA ?
Who did Shaq first play for ?
Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
With Hybrid Knowledge Base Resources
Either subjective, or hard to map against existing Structured KBs
Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
With Hybrid Knowledge Base Resources
Either subjective, or hard to map against existing Structured KBs
Using both structured knowledge bases and texts, e.g.,
Wikipedia or existing community QA archives.
Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
With Hybrid Knowledge Base Resources
who did shaq first play for
KB-QA
Entity Linking Relation Extraction
Joint Inference
shaq: m.012xdf
shaq: m.05n7bp
shaq: m.06_ttvh
sports.pro_athlete.teams..sports.sports_team_roster.team
basketball.player.statistics..basketball.player_stats.team
……
m.012xdf sports.pro_athlete.teams..sports.sports_team_roster.team
Los Angeles Lakers,
Boston Celtics,
Orlando Magic,
Miami Heat
Freebase
Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
With Hybrid Knowledge Base Resources
Answer Refinement
Los Angeles Lakers,
Boston Celtics,
Orlando Magic,
Miami Heat
Freebase
Shaquille O'Neal
O'Neal signed
as a free agent with the Los Angeles Lakers
Shaquille O'Neal
O'Neal played for
the Boston Celtics in the 2010-11 season before
retiring
Shaquille O'Neal
O'Neal was drafted
in the 1992 NBA draft
by the Orlando Magic with the first overall pick
Los Angeles Lakers Boston Celtics Orlando Magic
O’Neal was drafted by the Orlando
Magic with the first overall pick in
the 1992 NBA draft
O’Neal played for the Boston Celtics
in the 2010-11 season before retiring
O’Neal signed as a free agent
with the Los Angeles Lakers
Refinement Model
+- -
Orlando Magic
Wikipedia Dump
Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
With Hybrid Knowledge Base Resources
Textual
Relation Extraction
Triple SolverTriple Solver
who is the front man of the band that wrote Coffee & TV
Question Decomposition
< ans, is the front man of, var1 >
< var1 , is a , band >
< var1 , wrote , Coffee & TV >
< var1 , wrote, Coffee & TV >
Triple Solver
Entity Linking
Multi-Channel Neural Network
Paraphrase Model
Wikipedia Dump
Textual
KB
KB-based
Relation Extraction
DBpedia
Freebase
DBpedia Lookup
Coffee & TV
Bitter_Coffee_(Iranian_video
_series)
Irish_Coffee_(TV_series)
Coffee & TV
influencedBy
associatedMusicalArtist
associatedBand
writer
front man of
is written by
lead vocalist of
Open
Information Extractor
wrote
is the front man of
Joint Inference
Damon Albarn
Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
Conclusion
At this point...
still a lot to do for GaoKao
but, a flexible QA framework
With multiple resources, e.g., structured knowledge bases,
Wikipedia, text books, exercises, even news papers, etc.
Our collaborations with IBM China Research Lab
The Keys
From natural languages to knowledge bases
Inference over structured knowledge
Answer with common-sense knowledge
Understand various images, tables, figures, diagrams...
Feng et al. (PKU) Question Answering December 1, 2016 24 / 25
Conclusion
At this point...
still a lot to do for GaoKao
but, a flexible QA framework
With multiple resources, e.g., structured knowledge bases,
Wikipedia, text books, exercises, even news papers, etc.
Our collaborations with IBM China Research Lab
contribute to the Watson Competitions
contribute to a Multi-Modal QA system (with Vision China)
The Keys
From natural languages to knowledge bases → on the way
Inference over structured knowledge
Answer with common-sense knowledge
Understand various images, tables, figures, diagrams...
Feng et al. (PKU) Question Answering December 1, 2016 24 / 25
Conclusion
At this point...
still a lot to do for GaoKao
but, a flexible QA framework
With multiple resources, e.g., structured knowledge bases,
Wikipedia, text books, exercises, even news papers, etc.
Our collaborations with IBM China Research Lab
contribute to the Watson Competitions
contribute to a Multi-Modal QA system (with Vision China)
The Keys
From natural languages to knowledge bases → on the way
Inference over structured knowledge → challenging
Answer with common-sense knowledge
Understand various images, tables, figures, diagrams...
Feng et al. (PKU) Question Answering December 1, 2016 24 / 25
Conclusion
At this point...
still a lot to do for GaoKao
but, a flexible QA framework
With multiple resources, e.g., structured knowledge bases,
Wikipedia, text books, exercises, even news papers, etc.
Our collaborations with IBM China Research Lab
contribute to the Watson Competitions
contribute to a Multi-Modal QA system (with Vision China)
The Keys
From natural languages to knowledge bases → on the way
Inference over structured knowledge → challenging
Answer with common-sense knowledge → still missing
Understand various images, tables, figures, diagrams... → still
missing
Feng et al. (PKU) Question Answering December 1, 2016 24 / 25
Thanks & Questions
Feng et al. (PKU) Question Answering December 1, 2016 25 / 25

Mais conteúdo relacionado

Destaque

Cultures in Community Question Answering
Cultures in Community Question AnsweringCultures in Community Question Answering
Cultures in Community Question AnsweringNicolas Kourtellis
 
FIDO UAF Specifications: Overview & Tutorial
FIDO UAF Specifications: Overview & Tutorial FIDO UAF Specifications: Overview & Tutorial
FIDO UAF Specifications: Overview & Tutorial FIDO Alliance
 
Tutorial on Robustness of Recommender Systems
Tutorial on Robustness of Recommender SystemsTutorial on Robustness of Recommender Systems
Tutorial on Robustness of Recommender Systemsneilhurley
 
Answering Search Queries with CrowdSearcher: a crowdsourcing and social netwo...
Answering Search Queries with CrowdSearcher: a crowdsourcing and social netwo...Answering Search Queries with CrowdSearcher: a crowdsourcing and social netwo...
Answering Search Queries with CrowdSearcher: a crowdsourcing and social netwo...Marco Brambilla
 
Neural Network and NLP
Neural Network and NLPNeural Network and NLP
Neural Network and NLPMark Chang
 
Creating a new college
Creating a new collegeCreating a new college
Creating a new collegeJeff Allen
 
How New Grads Build Great Careers
How New Grads Build Great CareersHow New Grads Build Great Careers
How New Grads Build Great CareersLinkedIn
 
Cengage Learning Webinar, College Success, Creating Doers & Finishers: Cultiv...
Cengage Learning Webinar, College Success, Creating Doers & Finishers: Cultiv...Cengage Learning Webinar, College Success, Creating Doers & Finishers: Cultiv...
Cengage Learning Webinar, College Success, Creating Doers & Finishers: Cultiv...Cengage Learning
 
Eli building a college and hybrid
Eli building a college and hybridEli building a college and hybrid
Eli building a college and hybridstellas7
 
The Next Step - College Planning
The Next Step - College PlanningThe Next Step - College Planning
The Next Step - College Planningasim09
 
Creating a Future Forward College
Creating a Future Forward CollegeCreating a Future Forward College
Creating a Future Forward CollegeCynthia G. Wagner
 
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...YONG ZHENG
 
Strengthening the College and Career Culture
Strengthening the College and Career CultureStrengthening the College and Career Culture
Strengthening the College and Career Cultureccpc
 

Destaque (20)

FOAF & SIOC applications
FOAF & SIOC applicationsFOAF & SIOC applications
FOAF & SIOC applications
 
Cultures in Community Question Answering
Cultures in Community Question AnsweringCultures in Community Question Answering
Cultures in Community Question Answering
 
FIDO UAF Specifications: Overview & Tutorial
FIDO UAF Specifications: Overview & Tutorial FIDO UAF Specifications: Overview & Tutorial
FIDO UAF Specifications: Overview & Tutorial
 
Tutorial on Robustness of Recommender Systems
Tutorial on Robustness of Recommender SystemsTutorial on Robustness of Recommender Systems
Tutorial on Robustness of Recommender Systems
 
Answering Search Queries with CrowdSearcher: a crowdsourcing and social netwo...
Answering Search Queries with CrowdSearcher: a crowdsourcing and social netwo...Answering Search Queries with CrowdSearcher: a crowdsourcing and social netwo...
Answering Search Queries with CrowdSearcher: a crowdsourcing and social netwo...
 
Neural Network and NLP
Neural Network and NLPNeural Network and NLP
Neural Network and NLP
 
Creating a new college
Creating a new collegeCreating a new college
Creating a new college
 
How New Grads Build Great Careers
How New Grads Build Great CareersHow New Grads Build Great Careers
How New Grads Build Great Careers
 
Cengage Learning Webinar, College Success, Creating Doers & Finishers: Cultiv...
Cengage Learning Webinar, College Success, Creating Doers & Finishers: Cultiv...Cengage Learning Webinar, College Success, Creating Doers & Finishers: Cultiv...
Cengage Learning Webinar, College Success, Creating Doers & Finishers: Cultiv...
 
Eli building a college and hybrid
Eli building a college and hybridEli building a college and hybrid
Eli building a college and hybrid
 
Vantaa vocational college varia
Vantaa vocational college variaVantaa vocational college varia
Vantaa vocational college varia
 
The Next Step - College Planning
The Next Step - College PlanningThe Next Step - College Planning
The Next Step - College Planning
 
Social Media Goes to College
Social Media Goes to CollegeSocial Media Goes to College
Social Media Goes to College
 
M.O.S.A.I.C. Church Series Pt 1. Introduction (PerSpectives 12)
M.O.S.A.I.C. Church Series Pt 1. Introduction (PerSpectives 12)M.O.S.A.I.C. Church Series Pt 1. Introduction (PerSpectives 12)
M.O.S.A.I.C. Church Series Pt 1. Introduction (PerSpectives 12)
 
Creating a Future Forward College
Creating a Future Forward CollegeCreating a Future Forward College
Creating a Future Forward College
 
Vantaa Vocational College Varia
Vantaa Vocational College Varia Vantaa Vocational College Varia
Vantaa Vocational College Varia
 
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
 
Building Blocks for College Completion: Student Success
Building Blocks for College Completion: Student SuccessBuilding Blocks for College Completion: Student Success
Building Blocks for College Completion: Student Success
 
The Blueprint: Fundamentals of Building a Bible College
The Blueprint: Fundamentals of Building a Bible CollegeThe Blueprint: Fundamentals of Building a Bible College
The Blueprint: Fundamentals of Building a Bible College
 
Strengthening the College and Career Culture
Strengthening the College and Career CultureStrengthening the College and Career Culture
Strengthening the College and Career Culture
 

Semelhante a “Towards Building a Cognitive System to Fight for National College Admission Challenge”

1 African Leadership Centre (ALC) Important info.docx
1 African Leadership Centre (ALC)  Important info.docx1 African Leadership Centre (ALC)  Important info.docx
1 African Leadership Centre (ALC) Important info.docxpoulterbarbara
 
Orientation Programme Mathematics Post Graduates
Orientation Programme   Mathematics Post GraduatesOrientation Programme   Mathematics Post Graduates
Orientation Programme Mathematics Post GraduatesRAJ KUMAR
 
My College Freshman is Your High School Senior
My College Freshman is Your High School SeniorMy College Freshman is Your High School Senior
My College Freshman is Your High School SeniorCarol Smith
 
Introducing Teachers to the Next Generation Science Stand
Introducing Teachers to the Next Generation Science StandIntroducing Teachers to the Next Generation Science Stand
Introducing Teachers to the Next Generation Science StandSERC at Carleton College
 
K-16 Learning Continuums
K-16 Learning ContinuumsK-16 Learning Continuums
K-16 Learning ContinuumsCarol Smith
 
ASEE 2010: Using the Emergent Methodology of Domain Analysis to Answer Comple...
ASEE 2010: Using the Emergent Methodology of Domain Analysis to Answer Comple...ASEE 2010: Using the Emergent Methodology of Domain Analysis to Answer Comple...
ASEE 2010: Using the Emergent Methodology of Domain Analysis to Answer Comple...Research in Feminist Engineering Group
 
STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University Darci the STEM Mom
 
Research article #1
Research article #1Research article #1
Research article #1lsnourse
 
Harland Professional Development Follow Up Fall 2013
Harland Professional Development Follow Up Fall 2013Harland Professional Development Follow Up Fall 2013
Harland Professional Development Follow Up Fall 2013Darci the STEM Mom
 
Dr. Harland (STEM Mom) Speaks at South Dakota State University: Workshop Pres...
Dr. Harland (STEM Mom) Speaks at South Dakota State University: Workshop Pres...Dr. Harland (STEM Mom) Speaks at South Dakota State University: Workshop Pres...
Dr. Harland (STEM Mom) Speaks at South Dakota State University: Workshop Pres...Darci the STEM Mom
 
Assignment 2 Discussion QuestionBy Sunday, June 22, 2014 resp.docx
Assignment 2 Discussion QuestionBy Sunday, June 22, 2014 resp.docxAssignment 2 Discussion QuestionBy Sunday, June 22, 2014 resp.docx
Assignment 2 Discussion QuestionBy Sunday, June 22, 2014 resp.docxbobbywlane695641
 
Qualitative research problems
Qualitative research problemsQualitative research problems
Qualitative research problemsSugeng Hariyanto
 
JALT Kyoto Member Spotlight 2020
JALT Kyoto Member Spotlight 2020JALT Kyoto Member Spotlight 2020
JALT Kyoto Member Spotlight 2020Kazunori Nozawa
 
(Research in progress paper, presented at STI2014) Exploring the effects of ...
(Research in progress paper, presented at STI2014) Exploring the effects of ...(Research in progress paper, presented at STI2014) Exploring the effects of ...
(Research in progress paper, presented at STI2014) Exploring the effects of ...Masatsura IGAMI
 
Using Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open UniversityUsing Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open UniversityBart Rienties
 
Choosing a Research Topic.ppt
Choosing a Research Topic.pptChoosing a Research Topic.ppt
Choosing a Research Topic.pptLySa47
 
Assessing Science Learning In 3 Part Harmony
Assessing Science Learning In 3 Part HarmonyAssessing Science Learning In 3 Part Harmony
Assessing Science Learning In 3 Part Harmonyheasulli
 

Semelhante a “Towards Building a Cognitive System to Fight for National College Admission Challenge” (20)

1 African Leadership Centre (ALC) Important info.docx
1 African Leadership Centre (ALC)  Important info.docx1 African Leadership Centre (ALC)  Important info.docx
1 African Leadership Centre (ALC) Important info.docx
 
4/15/10 School of Engineering Education Research Seminar
4/15/10 School of Engineering Education Research Seminar4/15/10 School of Engineering Education Research Seminar
4/15/10 School of Engineering Education Research Seminar
 
Orientation Programme Mathematics Post Graduates
Orientation Programme   Mathematics Post GraduatesOrientation Programme   Mathematics Post Graduates
Orientation Programme Mathematics Post Graduates
 
My College Freshman is Your High School Senior
My College Freshman is Your High School SeniorMy College Freshman is Your High School Senior
My College Freshman is Your High School Senior
 
Introducing Teachers to the Next Generation Science Stand
Introducing Teachers to the Next Generation Science StandIntroducing Teachers to the Next Generation Science Stand
Introducing Teachers to the Next Generation Science Stand
 
K-16 Learning Continuums
K-16 Learning ContinuumsK-16 Learning Continuums
K-16 Learning Continuums
 
ASEE 2010: Using the Emergent Methodology of Domain Analysis to Answer Comple...
ASEE 2010: Using the Emergent Methodology of Domain Analysis to Answer Comple...ASEE 2010: Using the Emergent Methodology of Domain Analysis to Answer Comple...
ASEE 2010: Using the Emergent Methodology of Domain Analysis to Answer Comple...
 
STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University
 
R3 Setting the Research Agenda for Teaching and Learning Chinese
R3 Setting the Research Agenda for Teaching and Learning Chinese  R3 Setting the Research Agenda for Teaching and Learning Chinese
R3 Setting the Research Agenda for Teaching and Learning Chinese
 
Research article #1
Research article #1Research article #1
Research article #1
 
Harland Professional Development Follow Up Fall 2013
Harland Professional Development Follow Up Fall 2013Harland Professional Development Follow Up Fall 2013
Harland Professional Development Follow Up Fall 2013
 
Dr. Harland (STEM Mom) Speaks at South Dakota State University: Workshop Pres...
Dr. Harland (STEM Mom) Speaks at South Dakota State University: Workshop Pres...Dr. Harland (STEM Mom) Speaks at South Dakota State University: Workshop Pres...
Dr. Harland (STEM Mom) Speaks at South Dakota State University: Workshop Pres...
 
Assignment 2 Discussion QuestionBy Sunday, June 22, 2014 resp.docx
Assignment 2 Discussion QuestionBy Sunday, June 22, 2014 resp.docxAssignment 2 Discussion QuestionBy Sunday, June 22, 2014 resp.docx
Assignment 2 Discussion QuestionBy Sunday, June 22, 2014 resp.docx
 
Qualitative research problems
Qualitative research problemsQualitative research problems
Qualitative research problems
 
JALT Kyoto Member Spotlight 2020
JALT Kyoto Member Spotlight 2020JALT Kyoto Member Spotlight 2020
JALT Kyoto Member Spotlight 2020
 
(Research in progress paper, presented at STI2014) Exploring the effects of ...
(Research in progress paper, presented at STI2014) Exploring the effects of ...(Research in progress paper, presented at STI2014) Exploring the effects of ...
(Research in progress paper, presented at STI2014) Exploring the effects of ...
 
Using Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open UniversityUsing Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open University
 
Choosing a Research Topic.ppt
Choosing a Research Topic.pptChoosing a Research Topic.ppt
Choosing a Research Topic.ppt
 
Assessing Science Learning In 3 Part Harmony
Assessing Science Learning In 3 Part HarmonyAssessing Science Learning In 3 Part Harmony
Assessing Science Learning In 3 Part Harmony
 
Read 4534 001 March 23, 2010
Read 4534 001 March 23, 2010Read 4534 001 March 23, 2010
Read 4534 001 March 23, 2010
 

Mais de diannepatricia

Teaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsonTeaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsondiannepatricia
 
Cognitive systems institute talk 8 june 2017 - v.1.0
Cognitive systems institute talk   8 june 2017 - v.1.0Cognitive systems institute talk   8 june 2017 - v.1.0
Cognitive systems institute talk 8 june 2017 - v.1.0diannepatricia
 
Building Compassionate Conversational Systems
Building Compassionate Conversational SystemsBuilding Compassionate Conversational Systems
Building Compassionate Conversational Systemsdiannepatricia
 
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”diannepatricia
 
Cognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving AccessibilityCognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving Accessibilitydiannepatricia
 
Artificial Intellingence in the Car
Artificial Intellingence in the CarArtificial Intellingence in the Car
Artificial Intellingence in the Cardiannepatricia
 
“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”diannepatricia
 
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...diannepatricia
 
170330 cognitive systems institute speaker series mark sherman - watson pr...
170330 cognitive systems institute speaker series    mark sherman - watson pr...170330 cognitive systems institute speaker series    mark sherman - watson pr...
170330 cognitive systems institute speaker series mark sherman - watson pr...diannepatricia
 
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”diannepatricia
 
Cognitive Assistance for the Aging
Cognitive Assistance for the AgingCognitive Assistance for the Aging
Cognitive Assistance for the Agingdiannepatricia
 
From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"diannepatricia
 
The Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented IntelligenceThe Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented Intelligencediannepatricia
 
Developing Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team CognitionDeveloping Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team Cognitiondiannepatricia
 
Cyber-Social Learning Systems
Cyber-Social Learning SystemsCyber-Social Learning Systems
Cyber-Social Learning Systemsdiannepatricia
 
“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”diannepatricia
 
"Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ..."Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ...diannepatricia
 
Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50diannepatricia
 
KATE - a Platform for Machine Learning
KATE - a Platform for Machine LearningKATE - a Platform for Machine Learning
KATE - a Platform for Machine Learningdiannepatricia
 
Cognitive Computing for Aging Society
Cognitive Computing for Aging SocietyCognitive Computing for Aging Society
Cognitive Computing for Aging Societydiannepatricia
 

Mais de diannepatricia (20)

Teaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsonTeaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watson
 
Cognitive systems institute talk 8 june 2017 - v.1.0
Cognitive systems institute talk   8 june 2017 - v.1.0Cognitive systems institute talk   8 june 2017 - v.1.0
Cognitive systems institute talk 8 june 2017 - v.1.0
 
Building Compassionate Conversational Systems
Building Compassionate Conversational SystemsBuilding Compassionate Conversational Systems
Building Compassionate Conversational Systems
 
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
 
Cognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving AccessibilityCognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving Accessibility
 
Artificial Intellingence in the Car
Artificial Intellingence in the CarArtificial Intellingence in the Car
Artificial Intellingence in the Car
 
“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”
 
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
 
170330 cognitive systems institute speaker series mark sherman - watson pr...
170330 cognitive systems institute speaker series    mark sherman - watson pr...170330 cognitive systems institute speaker series    mark sherman - watson pr...
170330 cognitive systems institute speaker series mark sherman - watson pr...
 
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
 
Cognitive Assistance for the Aging
Cognitive Assistance for the AgingCognitive Assistance for the Aging
Cognitive Assistance for the Aging
 
From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"
 
The Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented IntelligenceThe Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented Intelligence
 
Developing Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team CognitionDeveloping Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team Cognition
 
Cyber-Social Learning Systems
Cyber-Social Learning SystemsCyber-Social Learning Systems
Cyber-Social Learning Systems
 
“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”
 
"Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ..."Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ...
 
Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50
 
KATE - a Platform for Machine Learning
KATE - a Platform for Machine LearningKATE - a Platform for Machine Learning
KATE - a Platform for Machine Learning
 
Cognitive Computing for Aging Society
Cognitive Computing for Aging SocietyCognitive Computing for Aging Society
Cognitive Computing for Aging Society
 

Último

IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 

Último (20)

20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 

“Towards Building a Cognitive System to Fight for National College Admission Challenge”

  • 1. Towards Building a Cognitive System to Fight for National College Admission Challenge Yansong Feng Joint work with Kun Xu, Songfang Huang, Dongyan Zhao Peking University IBM China Research Lab December 1, 2016 Feng et al. (PKU) Question Answering December 1, 2016 1 / 25
  • 2. Pass the Exam: A New AI Challenge The Todai Robot Project National Institute of Informatics and collaborators National Center Test for University Admissions ( 2016) Entrance Exam of University of Tokyo (2021) Feng et al. (PKU) Question Answering December 1, 2016 2 / 25
  • 3. Pass the Exam: A New AI Challenge The Todai Robot Project National Institute of Informatics and collaborators National Center Test for University Admissions ( 2016) Entrance Exam of University of Tokyo (2021) Japanese, Social Science, Math, Physics Feng et al. (PKU) Question Answering December 1, 2016 2 / 25
  • 4. Pass the Exam: A New AI Challenge The Todai Robot Project National Institute of Informatics and collaborators National Center Test for University Admissions ( 2016) Entrance Exam of University of Tokyo (2021) Japanese, Social Science, Math, Physics The Project Aristo and Euclid The Allen Institute for Artificial Intelligence Elementary School: High School: Feng et al. (PKU) Question Answering December 1, 2016 2 / 25
  • 5. Pass the Exam: A New AI Challenge The Todai Robot Project National Institute of Informatics and collaborators National Center Test for University Admissions ( 2016) Entrance Exam of University of Tokyo (2021) Japanese, Social Science, Math, Physics The Project Aristo and Euclid The Allen Institute for Artificial Intelligence Elementary School: Science and Math High School: Geometry Feng et al. (PKU) Question Answering December 1, 2016 2 / 25
  • 6. The GaoKao Challenge Gaokao in China National College Entrance Examination Chinese, Math, English, History, Geography, Politics, Physics, Chemistry, Biology over 9,400,000 students in 2016 Feng et al. (PKU) Question Answering December 1, 2016 3 / 25
  • 7. The GaoKao Challenge Gaokao in China National College Entrance Examination Chinese, Math, English, History, Geography, Politics, Physics, Chemistry, Biology over 9,400,000 students in 2016 The China Gaokao Challenge Prompt research in Artificial Intelligence Team: national research institutes, universities and companies Real National College Entrance Examinations Chinese, History, Math, Geography Feng et al. (PKU) Question Answering December 1, 2016 3 / 25
  • 8. The GaoKao Challenge Gaokao in China National College Entrance Examination Chinese, Math, English, History, Geography, Politics, Physics, Chemistry, Biology over 9,400,000 students in 2016 The China Gaokao Challenge Prompt research in Artificial Intelligence Team: national research institutes, universities and companies Real National College Entrance Examinations Chinese, History, Math, Geography Feng et al. (PKU) Question Answering December 1, 2016 3 / 25
  • 9. Is that Difficult? Which is the correct ranking of provinces according to their average altitutes, from highest to lowest? Xiang, Liao, Ning Tai, Lu, Su Qing, Yue, Jin Gui, Gan, Yu Feng et al. (PKU) Question Answering December 1, 2016 4 / 25
  • 10. Is that Difficult? Which is the correct ranking of provinces according to their average altitutes, from highest to lowest? Xiang, Liao, Ning → Hunan, Liaoning, Ningxia Tai, Lu, Su →Taiwan, Shandong, Jiangsu Qing, Yue, Jin →Qinghua, Guangdong, Shanxi Gui, Gan, Yu → Guangxi, Gansu, Henan 1 Knowledge: short names of provinces average altitudes of provinces Feng et al. (PKU) Question Answering December 1, 2016 4 / 25
  • 11. Is that Difficult? Which is the correct ranking of provinces according to their average altitutes, from highest to lowest? Xiang, Liao, Ning → Hunan, Liaoning, Ningxia Tai, Lu, Su →Taiwan, Shandong, Jiangsu Qing, Yue, Jin →Qinghua, Guangdong, Shanxi Gui, Gan, Yu → Guangxi, Gansu, Henan 1 Knowledge: short names of provinces average altitudes of provinces 2 Reasoning relative comparisons of provinces’ altitude ranking Feng et al. (PKU) Question Answering December 1, 2016 4 / 25
  • 12. Is that Difficult? Which is the correct ranking of provinces according to their average altitutes, from highest to lowest? Xiang, Liao, Ning → Hunan, Liaoning, Ningxia Tai, Lu, Su →Taiwan, Shandong, Jiangsu Qing, Yue, Jin →Qinghua, Guangdong, Shanxi Gui, Gan, Yu → Guangxi, Gansu, Henan 1 Knowledge: short names of provinces average altitudes of provinces 2 Reasoning relative comparisons of provinces’ altitude ranking Not very challenging? Feng et al. (PKU) Question Answering December 1, 2016 4 / 25
  • 13. What about this one? Missouri River Valley is an important agricultural area of the United States. Aerial figure 1 shows the winter of the Missouri River, where the white part is snow. 1. Why is the farmland on the peninsula shaped as circular? their watering approach rugged terrain their farming approach lack of farmland Feng et al. (PKU) Question Answering December 1, 2016 5 / 25
  • 14. What about this one? 2. Could you have a guess what is the main crop in this area? Winter wheat Corn Rice Potato Feng et al. (PKU) Question Answering December 1, 2016 6 / 25
  • 15. What about this one? 2. Could you have a guess what is the main crop in this area? Winter wheat Corn Rice Potato 1 Knowledge: agriculture climate longitude and latitude read maps and images Feng et al. (PKU) Question Answering December 1, 2016 6 / 25
  • 16. What about this one? 2. Could you have a guess what is the main crop in this area? Winter wheat Corn Rice Potato 1 Knowledge: agriculture climate longitude and latitude read maps and images 2 Reasoning relationship among those factors find analogies common sense knowledge Feng et al. (PKU) Question Answering December 1, 2016 6 / 25
  • 17. What about this one? 2. Could you have a guess what is the main crop in this area? Winter wheat Corn Rice Potato 1 Knowledge: agriculture climate longitude and latitude read maps and images 2 Reasoning relationship among those factors find analogies common sense knowledge Not very challenging? Feng et al. (PKU) Question Answering December 1, 2016 6 / 25
  • 18. What We Need? 1 Solid knowledge: every aspects about the Syllabus 2 Math 3 Reasoning: logical inference use common sense knowledge textual entailment Feng et al. (PKU) Question Answering December 1, 2016 7 / 25
  • 19. What We Need? 1 Solid knowledge: every aspects about the Syllabus 2 Math 3 Reasoning: logical inference use common sense knowledge textual entailment A practical starting point: Answering Factoid Questions with Knowledge Feng et al. (PKU) Question Answering December 1, 2016 7 / 25
  • 20. What We Need? 1 Solid knowledge: every aspects about the Syllabus 2 Math 3 Reasoning: logical inference use common sense knowledge textual entailment A practical starting point: Answering Factoid Questions with Knowledge Information Retrieval Based Question Answering Answering Factoid Questions with Structured Knowledge Base Answering Factoid Questions with both Structured and Unstructured KBs Feng et al. (PKU) Question Answering December 1, 2016 7 / 25
  • 21. What We Need? 1 Solid knowledge: every aspects about the Syllabus (Knowledge Bases) 2 Math 3 Reasoning: logical inference use common sense knowledge (a little bit) textual entailment A practical starting point: Answering Factoid Questions with Knowledge Information Retrieval Based Question Answering Answering Factoid Questions with Structured Knowledge Base Answering Factoid Questions with both Structured and Unstructured KBs Feng et al. (PKU) Question Answering December 1, 2016 7 / 25
  • 22. The Task What else did the director of the movie Interstellar direct ? fb:m.0fkf28 fb:object.type fb:film.film fb:m.0fkf28 fb:film.film.directed_by ?x [ ] select ?y ?x fb:film.director.fim ?y ?y fb:object.type fb:film.film Inception, The Dark Knight Rises The Dark Knight Batman Begins ….. Feng et al. (PKU) Question Answering December 1, 2016 8 / 25
  • 23. The Task What else did the director of the movie Interstellar direct ? fb:m.0fkf28 fb:object.type fb:film.film fb:m.0fkf28 fb:film.film.directed_by ?x [ ] select ?y ?x fb:film.director.fim ?y ?y fb:object.type fb:film.film Inception, The Dark Knight Rises The Dark Knight Batman Begins ….. Feng et al. (PKU) Question Answering December 1, 2016 8 / 25
  • 24. Question Answering over Structured Knowledge Bases Goal Answer Natural Language Questions against Structured Knowledge Bases Feng et al. (PKU) Question Answering December 1, 2016 9 / 25
  • 25. Related Work Information Retrieval Community Natural Language Processing Community Semantic Parsing Based PCCG style: (Zettlemoyer and Collins, 2005, Cai and Yates, 2013; Kwiatkowski et al. 2013, Reddy et al., 2014) Syntactic parsing style: (Clarke et al., 2010, Liang et al., 2011, Berant et al. 2013, Berant and Liang, 2014, Xu et al., 2014) Information Extraction Based (Yao and van Durme 2014, Bao et al., 2014, Yih et al., 2015, Dong et al., 2015) Deep Learning, End2End style (Bordes et al., 2014a, 2014b, Yang et al., 2014, Bordes et al., 2015, Zhang et al., 2016 ) Feng et al. (PKU) Question Answering December 1, 2016 10 / 25
  • 26. Related Work Information Retrieval Community Natural Language Processing Community Semantic Parsing Based PCCG style: (Zettlemoyer and Collins, 2005, Cai and Yates, 2013; Kwiatkowski et al. 2013, Reddy et al., 2014) Syntactic parsing style: (Clarke et al., 2010, Liang et al., 2011, Berant et al. 2013, Berant and Liang, 2014, Xu et al., 2014) Information Extraction Based (Yao and van Durme 2014, Bao et al., 2014, Yih et al., 2015, Dong et al., 2015) Deep Learning, End2End style (Bordes et al., 2014a, 2014b, Yang et al., 2014, Bordes et al., 2015, Zhang et al., 2016 ) Feng et al. (PKU) Question Answering December 1, 2016 10 / 25
  • 27. Semantic Parsing Based Methods Challenges: 1 Convert questions into proper meaning representations 2 Ground the meaning representation into a database query Feng et al. (PKU) Question Answering December 1, 2016 11 / 25
  • 28. Semantic Parsing Based Methods Challenges: 1 Convert questions into proper meaning representations 2 Ground the meaning representation into a database query Previously: 1 Search space is huge 2 Difficult to adapt to other KBs Feng et al. (PKU) Question Answering December 1, 2016 11 / 25
  • 29. Motivation 1 Meaning representation should be KB-independent [what] did the director of] [the movie] [Interstellar]else movies] [direct] Feng et al. (PKU) Question Answering December 1, 2016 12 / 25
  • 30. Motivation 1 Meaning representation should be KB-independent [what] did the director of] [the movie] [Interstellar]else movies] [direct] 2 Separation of meaning representation and instantiation fb:m.0fkf28 fb:object.type fb:film.film fb:m.0fkf28 fb:film.film.directed_by ?x [ ] select ?y ?x fb:film.director.fim ?y ?y fb:object.type fb:film.film ns:Interstellar dbo:type dbo:film dbp:director ?x [ ] select ?y ?y ?y ns:Interstellar dbp:director ?x dbo:filmdbo:type Feng et al. (PKU) Question Answering December 1, 2016 12 / 25
  • 31. Framework what else movies did the director of the movie Interstellar direct Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
  • 32. Framework what else movies did the director of the movie Interstellar direct Parsing Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
  • 33. Framework what else movies did the director of the movie Interstellar direct Parsing [what] did the director of] [the movie] [Interstellar] variable relation category entity else movies] [direct] category relation Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
  • 34. Framework what else movies did the director of the movie Interstellar direct Parsing [what] did the director of] [the movie] [Interstellar] variable relation category entity else movies] [direct] category relation Instantiation Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
  • 35. Framework what else movies did the director of the movie Interstellar direct Parsing [what] did the director of] [the movie] [Interstellar] variable relation category entity else movies] [direct] category relation Instantiation fb:m.0fkf28 fb:object.type fb:film.film fb:m.0fkf28 fb:film.film.directed_by ?x [ ] select ?y ?x fb:film.director.fim ?y ?y fb:object.type fb:film.film Feng et al. (PKU) Question Answering December 1, 2016 13 / 25
  • 36. Phrase Dependency Graph [what] did the director of] [the movie] [Interstellar] variable relation category entity else movies] [direct] category relation Node A phrase with a semantic label l ∈ {entity, category, variable, relation} Edge A predicate-argument dependency between phrases unary predicate binary predicate Feng et al. (PKU) Question Answering December 1, 2016 14 / 25
  • 37. Structure Prediction Input: a natural language question Output: a phrase dependency graph A pipeline framework to predict the structure 1 Phrase Detection what did the director of the movie Interstellar variable relation category entity else movies direct category relation 2 Phrase Dependency Parsing [what] did the director of] [the movie] [Interstellar] variable relation category entity else movies] [direct] category relation Feng et al. (PKU) Question Answering December 1, 2016 15 / 25
  • 38. Instantiation [what] did the director of] [the movie] [Interstellar] variable relation category entity else movies] [direct] category relation 1 Converting Phrase Dependency Graph into Structured Queries 2 Instantiating Structured Query against KB Feng et al. (PKU) Question Answering December 1, 2016 16 / 25
  • 39. Applying Rules [what] did the director of] [the movie] [Interstellar] variable relation category entity else movies] [direct] category relation variable category variablecategory rule#1 rule#1 variablerelationrelationentity rule#8 ?y type movies type ?x ?x ?y moviesInterstellar Interstellar direct the director of [ ] select ?y type moviesInterstellar ?xInterstellar the director of ?x ?ydirect ?y type movies Feng et al. (PKU) Question Answering December 1, 2016 17 / 25
  • 40. Probabilistic Model [ ] select ?y type moviesInterstellar ?xInterstellar the director of ?x ?ydirect ?y type movies Qind Qd ns:Interstellar dbo:type dbo:film dbp:director ?x [ ] select ?y ?y ?y ns:Interstellar dbp:director ?x dbo:filmdbo:type Q∗ d = arg max P(Qd |Qind ) P(Qd |Qind ) = n i=1 P(sdi |sindi )P(odi |oindi )P(pdi |pindi ) Feng et al. (PKU) Question Answering December 1, 2016 18 / 25
  • 41. P(sdi |sindi )P(odi |oindi ) Freebase Search API ⇒ wikipedia ID ⇒ DBpedia Entity P(pd |pind ) We construct the co-occurrence matrix from the patty relation phrase dataset which includes 1,631,530 relation phrases Feng et al. (PKU) Question Answering December 1, 2016 19 / 25
  • 42. Results on QALDs Question Answering over Linked Data Processed Right Partial Recall Precision F-1 2014 40 34 6 0.71 0.72 0.72 2015 42 26 7 0.72 0.74 0.73 Feng et al. (PKU) Question Answering December 1, 2016 20 / 25
  • 43. Results on QALDs Question Answering over Linked Data Processed Right Partial Recall Precision F-1 2014 40 34 6 0.71 0.72 0.72 2015 42 26 7 0.72 0.74 0.73 First Place in CLEF QALD 4 and 5 Feng et al. (PKU) Question Answering December 1, 2016 20 / 25
  • 44. Results on QALDs Question Answering over Linked Data Processed Right Partial Recall Precision F-1 2014 40 34 6 0.71 0.72 0.72 2015 42 26 7 0.72 0.74 0.73 Nice for longer/complex sentences Efficient: around 0.33 sec per sentence Feng et al. (PKU) Question Answering December 1, 2016 20 / 25
  • 45. Results on QALDs Question Answering over Linked Data Processed Right Partial Recall Precision F-1 2014 40 34 6 0.71 0.72 0.72 2015 42 26 7 0.72 0.74 0.73 Nice for longer/complex sentences Efficient: around 0.33 sec per sentence Consistent performances 0.76 of F-1 on Free917 0.41 of F-1 on WebQuestions Feng et al. (PKU) Question Answering December 1, 2016 20 / 25
  • 46. Further Improvement Semantic interpretation for superlatives Nile is the longest river in the world. Keys: the target: Nile the comparison set: all rivers in the world the comparison dimension: the length of a river →/geography/river/length the ranking order: descending Feng et al. (PKU) Question Answering December 1, 2016 21 / 25
  • 47. A Little More Extraction For simple sentences: Who does michael keaton play in cars Who michael keaton cars Michael Keaton The Merry Gentleman Penthouse North cvt1 Cars cvt2 Chick Hicks film starring starring filmdirect direct by ctv3 spouse_s Caroline McWilliams spousespouse_s spouse 6/5/1982 from 1/29/1990 to Marriage type of union character portrayer film character starring charactercharacter Question: Star Graph: Freebase Graph: cvt3 film actor Leona Elizabeth Loftus George A. Douglas parents child Feng et al. (PKU) Question Answering December 1, 2016 22 / 25
  • 48. A Little More Extraction For simple sentences: Join Entitly Linking and Relation Extraction gives 0.49 (+0.06) F1 on WebQuestions. Feng et al. (PKU) Question Answering December 1, 2016 22 / 25
  • 49. With Hybrid Knowledge Base Resources a little bit complex... Where should a visitor see in Germany ? Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
  • 50. With Hybrid Knowledge Base Resources a little bit complex... Where should a visitor see in Germany ? What is the most popular crop during 1900s in USA ? Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
  • 51. With Hybrid Knowledge Base Resources a little bit complex... Where should a visitor see in Germany ? What is the most popular crop during 1900s in USA ? Who did Shaq first play for ? Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
  • 52. With Hybrid Knowledge Base Resources Either subjective, or hard to map against existing Structured KBs Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
  • 53. With Hybrid Knowledge Base Resources Either subjective, or hard to map against existing Structured KBs Using both structured knowledge bases and texts, e.g., Wikipedia or existing community QA archives. Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
  • 54. With Hybrid Knowledge Base Resources who did shaq first play for KB-QA Entity Linking Relation Extraction Joint Inference shaq: m.012xdf shaq: m.05n7bp shaq: m.06_ttvh sports.pro_athlete.teams..sports.sports_team_roster.team basketball.player.statistics..basketball.player_stats.team …… m.012xdf sports.pro_athlete.teams..sports.sports_team_roster.team Los Angeles Lakers, Boston Celtics, Orlando Magic, Miami Heat Freebase Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
  • 55. With Hybrid Knowledge Base Resources Answer Refinement Los Angeles Lakers, Boston Celtics, Orlando Magic, Miami Heat Freebase Shaquille O'Neal O'Neal signed as a free agent with the Los Angeles Lakers Shaquille O'Neal O'Neal played for the Boston Celtics in the 2010-11 season before retiring Shaquille O'Neal O'Neal was drafted in the 1992 NBA draft by the Orlando Magic with the first overall pick Los Angeles Lakers Boston Celtics Orlando Magic O’Neal was drafted by the Orlando Magic with the first overall pick in the 1992 NBA draft O’Neal played for the Boston Celtics in the 2010-11 season before retiring O’Neal signed as a free agent with the Los Angeles Lakers Refinement Model +- - Orlando Magic Wikipedia Dump Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
  • 56. With Hybrid Knowledge Base Resources Textual Relation Extraction Triple SolverTriple Solver who is the front man of the band that wrote Coffee & TV Question Decomposition < ans, is the front man of, var1 > < var1 , is a , band > < var1 , wrote , Coffee & TV > < var1 , wrote, Coffee & TV > Triple Solver Entity Linking Multi-Channel Neural Network Paraphrase Model Wikipedia Dump Textual KB KB-based Relation Extraction DBpedia Freebase DBpedia Lookup Coffee & TV Bitter_Coffee_(Iranian_video _series) Irish_Coffee_(TV_series) Coffee & TV influencedBy associatedMusicalArtist associatedBand writer front man of is written by lead vocalist of Open Information Extractor wrote is the front man of Joint Inference Damon Albarn Feng et al. (PKU) Question Answering December 1, 2016 23 / 25
  • 57. Conclusion At this point... still a lot to do for GaoKao but, a flexible QA framework With multiple resources, e.g., structured knowledge bases, Wikipedia, text books, exercises, even news papers, etc. Our collaborations with IBM China Research Lab The Keys From natural languages to knowledge bases Inference over structured knowledge Answer with common-sense knowledge Understand various images, tables, figures, diagrams... Feng et al. (PKU) Question Answering December 1, 2016 24 / 25
  • 58. Conclusion At this point... still a lot to do for GaoKao but, a flexible QA framework With multiple resources, e.g., structured knowledge bases, Wikipedia, text books, exercises, even news papers, etc. Our collaborations with IBM China Research Lab contribute to the Watson Competitions contribute to a Multi-Modal QA system (with Vision China) The Keys From natural languages to knowledge bases → on the way Inference over structured knowledge Answer with common-sense knowledge Understand various images, tables, figures, diagrams... Feng et al. (PKU) Question Answering December 1, 2016 24 / 25
  • 59. Conclusion At this point... still a lot to do for GaoKao but, a flexible QA framework With multiple resources, e.g., structured knowledge bases, Wikipedia, text books, exercises, even news papers, etc. Our collaborations with IBM China Research Lab contribute to the Watson Competitions contribute to a Multi-Modal QA system (with Vision China) The Keys From natural languages to knowledge bases → on the way Inference over structured knowledge → challenging Answer with common-sense knowledge Understand various images, tables, figures, diagrams... Feng et al. (PKU) Question Answering December 1, 2016 24 / 25
  • 60. Conclusion At this point... still a lot to do for GaoKao but, a flexible QA framework With multiple resources, e.g., structured knowledge bases, Wikipedia, text books, exercises, even news papers, etc. Our collaborations with IBM China Research Lab contribute to the Watson Competitions contribute to a Multi-Modal QA system (with Vision China) The Keys From natural languages to knowledge bases → on the way Inference over structured knowledge → challenging Answer with common-sense knowledge → still missing Understand various images, tables, figures, diagrams... → still missing Feng et al. (PKU) Question Answering December 1, 2016 24 / 25
  • 61. Thanks & Questions Feng et al. (PKU) Question Answering December 1, 2016 25 / 25