Watson & Open Source: Understanding How IBM's AI System Works

Watson & Open Source
Software

Ivan Portilla
IT Architect
5/8/12
portilla@gmail.com

Sunday, May 20, 12 1

If I have seen further it is by standing on the
shoulders of giants.

Isaac Newton, Letter to Robert Hooke, February 5, 1675


Objectives
By the end of this session, you
should be able to:
ü Describe the main characteristics
of Watson QA system.
ü Identify the key open source SW
used in Watson.
ü Recognize examples of Agile
development best practices.

3


Disclaimers


Disclaimer 1
ü This presentation represents the view of the
author and does not represent the view of IBM.
ü All opinions expressed in this presentation are
strictly of the speaker, and do NOT represent
those of IBM, IBM management, or anyone else.
ü IBM and IBM (logo) are trademarks or registered
trademarks of International Business Machines
Corporation in the United States and/or other
countries.


Disclaimer
2
I
(We)
do
not
work
for
the
Watson
team.


Let’s Play Jeopardy


BEFORE & AFTER: The Jerry Maguire star who
automatically maintains your vehicle’s speed.



COMMON BONDS: trout, loose change in your pocket,
and compliments.



and compliments.

Diplomatic Relations: Of the four countries in the
world that the United States does not have diplomatic
relations with, the one that’s farthest north.



and compliments.

Diplomatic Relations: Of the four countries in the
world that the United States does not have diplomatic
relations with, the one that’s farthest north.

Geography: Chile shares its longest land border with
this country


Natural
Language
Processing

Understanding
natural
language
is
hard!

Watson
educa@on

hAp://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=6177717


A Brief History of Watson


A Brief History of Watson
§ Deep Blue Ended in 1997
§ Looking for a new research challenge
§ 2004, IBM Research manager Charles Lickel,
§ Ken Jennings
§ Started in 2005
• David Ferrucci
• DeepQA in 2007
• Won Jeopardy Match, Feb 2011



11/2010

4/2010

10/2009

5/2009

12/2008
Precision

8/2008

5/2008
12/2007

Baseline


What
is
Watson?
ü Understands
natural

language.
ü Generates
&
evaluates

hypothesis
for
beAer

outcomes.
ü Adapts
&
learns
from

user
selec@ons
and

responses.

hAp://www.ibm.com/innova@on/us/watson/


Watson
metrics
Development Team: 25 people
Project Duration: 4 years

Hardware: 90 IBM Power-750 servers
2880 Power7 cores @ 80+ TFLOPS
20 TB Disk, 16 TB RAM (memory)
10 Gbps network

hAp://na11.apachecon.com/talks/19932


Open Source Software


OSS
-‐
Linux

hAp://video.linux.com/videos/linuxcon-‐vancouver-‐day-‐2-‐1/


Open
Source
too

hAp://ocw.mit.edu/index.htm hAp://@.arc.nasa.gov/opensource/


How does it work?


Learning To Rank (Basic Architecture)

Hypothesis
Keywords Evidence
Scoring

Watson
by
R.Yates

Watson
Architecture

hAp://en.wikipedia.org/wiki/Watson_(computer)


Who is the 44th President of the
United States?


Who is the 44th President of the United States?

Who is the 44th President
of the United States?

Watson
by
R.Yates


'Who' is the '44th' 'President' of the 'United States'?

Who is the 44th President
of the United States?

Lexical Focus Keywords
Answer
Type Can be replaced
by the correct
answer to make a
→ Person
true statement



Keywords:
44th President United States

Question

Question Hypothesis
Analysis Generation

Watson
by
R.Yates


Keywords:
44th President United States

Question

Question Hypothesis
Analysis Generation



Primary
Search

Question

Question Hypothesis
Analysis Generation



Barack Obama
George W. Bush
Harvard Law School
Illinois

Primary
Search

Question

Question Hypothesis
Analysis Generation

Watson
by
R.Yates


Barack Obama

George W. Bush

Answer
Who is the 44th President of the United States? Scoring
Harvard Law School

Illinois Question

Scoring
Question Hypothesis Scoring
Analysis Generation
Scoring



Barack Obama
Who is the 44th President of the United
States?
George W. Bush Answer
Answer
Scoring Contextual → Person
Scoring
Answer Answer
Who is the 44th President of the United States? Answer
Scoring Scoring Is Barack Obama a Person? .90
Harvard Law School Scoring Is George W. Bush a Person? .90
Is Harvard Law School a Person? .10
Who is the 44th President of the United States? Is Illinois a Person? .15
Illinois Question

Scoring
Analysis Generation
Scoring

Watson
by
R.Yates


Barack Obama is the 44th President of the United States
George W. Bush is the 44th President of the United States
Harvard Law School is the 44th President of the United States
Illinois is the 44th President of the United States
Contextual
Answer
Scoring

Question

Scoring
Analysis Generation
Scoring

Unstructured
Informa@on
Management
Applica@ons
-‐
UIMA


Barack Hussein Obama II (i/bəәˈrɑːk huːˈseɪn oʊˈbɑːməә/;
born August 4, 1961) is the 44th and current President of
the United States.

George Walker Bush (born July 6, 1946) is an American
politician who served as the 43rd President of the United
States from 2001 to 2009 and the 46th Governor of Texas
from 1995 to 2000.

Barack Obama is the 44th President of the United States
George W. Bush is the 44th President of the United States
Harvard Law School is the 44th President of the United States
Illinois is the 44th President of the United States

Question Barack Obama .95
George W. Bush .80
Scoring Harvard Law School .05
Question Hypothesis Scoring Illinois.10
Analysis Generation
Scoring

Unstructured
Informa@on
Management
Applica@ons
-‐
UIMA

Watson
by
R.Yates

Candidate Answer Answer Evidence retrieval & Confidence
Scoring scoring

Barack Obama 0.90 0.90 .95
George W. Bush 0.90 0.80 .65
Evidence
Harvard Law School 0.10 0.05 Retrieval .05
Illinois 0.15 0.10 .10
Trained
Question Models

Scoring
Analysis Generation
Scoring

Unstructured
Informa@on
Management
Applica@ons
-‐
UIMA

Watson
by
R.Yates

DeepQA
Massively Parallel Probabilistic Evidence-Based Architecture

Learned Models
help combine and
weigh the Evidence
Evidence Balance
Answer Sources & Combine
Models Models
Sources
Question Answer Evidence
Models Models
Scoring Retrieval
Primary Candidate
& Scoring Models Models
Search Answer
Generation

Ques@on
&
Final
Conﬁdence

Ques@on Hypothesis Hypothesis
and
Evidence

Topic
Synthesis Merging
&

Decomposi@on Genera@on Scoring
Analysis Ranking

Hypothesis Hypothesis and Merging & Answer &
Evidence Scoring Ranking
Genera@on Confidence
...
ApacheCon
2011,
Watson,
a
Reasoning
System:
based
on
Apache
Inside!,
David
Boloker


OSS in Watson 1.0


OSS
in
Watson

üUIMA,
UIMA-‐AS
üHadoop,
Map
Reduce
üLucene,
Indri

ApacheCon
2011,
Watson,
a
Reasoning
System:
based
on
Apache
Inside!,
David
Boloker


UIMA

hAp://uima.apache.org/


UIMA-‐Asynchronous
Scaleout
UIMA
AS
provides
more
ﬂexible
and
powerful
scale
out

capability.

Innovate 2011, How Does It Work? The Architecture of Watson. Grady Booch


Think
Hadoop

A
framework
for
storing

&
processing
big
data.
üUp
to
4,000
machines
üUp
to
20
PB

High
reliability
done
in
soiware:
üAutomated
failover
for
data
&

computa@on
üImplemented
in
Java
hAp://hadoop.apache.org/mapreduce/


Map
reduce

hAp://hadoop.apache.org/mapreduce/


UIMA
pipelines
in
Hadoop
Mul@ple
threads,
each
runing
a

UIMA
pipeline
Thread
Thread

Input Mapper .
.
. Output
Thread
Thread

Thread Reducer
Mapper Thread
.
.
.
~5000
“splits”

Shuﬄe/Sort
. .
Thread
Thread .
.
~50
-‐
100

. .
“mappers” ~400-‐800

threads
. . Thread
.
Thread
Mapper .
.
.
Thread Reducer
Hadoop Thread
Hadoop
Distributed Thread Distributed
File Mapper Thread
File
.
.
.
System Thread System
Thread

hAp://blogs.apache.org/founda@on/entry/apache_innova@on_bolsters_ibm_s
41


Architecture

hAp://lucene.apache.org


Indri
&Lemur
Indri
is
a
text
search
engine
developed
at
Umass
&
CMU.
Indri
is
part
of
the

Lemur
project.

hAp://lemurproject.org/indri/


Watson
answers
in
2-‐6
seconds

Ques@on 1000’s
of

100s
Possible
100,000’s
scores
from
many
simultaneous
Text

Pieces
of
Evidence Analysis
Algorithms
100s

sources Answers
Mul@ple

Interpreta@ons

Ques@on
&
Ques@on Hypothesis Hypothesis
and
Evidence

Final
Conﬁdence

Synthesis
Topic
Analysis Decomposi@on Genera@on Scoring Merging
&
Ranking

Hypothesis Hypothesis
and
Evidence

Genera@on Scoring Answer
&

Conﬁdence
.
.
.

ApacheCon
2011,
Watson,
a
Reasoning
System:
based
on
Apache
Inside!,
David
Boloker

© 2011 IBM Corporation


Other
OSS
in
Watson

hAps://www.ibm.com/developerworks/mydeveloperworks/blogs/InsideSystemStorage/entry/
ibm_watson_how_to_build_your_own_watson_jr_in_your_basement7?lang=en


J-‐Archive
data

hAp://www.j-‐archive.com/showgame.php?game_id=3577

Development Process

üWar room setting with
continuous collaboration.
üWeekly integration.
üResults driven with E2E
regression testing.

ü About 8,000 experiments
ü 10 GBs of test data/wk.
ü Agile development

Innovate 2011, How Does It Work? The Architecture of Watson. Grady Booch


Other
OSS

hAp://manning.com/ hAp://www.apache.org


Take
Away
OSS
is
powerful
and
scalable
enough

for
the
Watson
team,
what
about

your
project?


Resources
IBM
Journal
of
Research
and
Development
IBM
Watson
hAp://www.ibm.com/innova@on/us/watson/
hAp://www.research.ibm.com/deepqa/index.shtml

Nova
hAp://www.pbs.org/wgbh/nova/tech/smartest-‐machine-‐on-‐earth.html


Review of Objectives
Now that you have completed this session, you are able to:

ü Describe the main characteristics of Watson QA system.
ü Identify the key open source tools used in Watson.
ü Recognize examples of Agile development best practices.

51


…any ﬁnal
questions ?

52


Watson & Open Source: Understanding How IBM's AI System Works

Recomendados

Recomendados

Mais conteúdo relacionado

Semelhante a Watson & Open Source: Understanding How IBM's AI System Works

Semelhante a Watson & Open Source: Understanding How IBM's AI System Works (20)

Mais de Boulder Java User's Group

Mais de Boulder Java User's Group (8)

Último

Último (20)

Watson & Open Source: Understanding How IBM's AI System Works