1. @pieroleo
Cognitive Computing
How Artificial Intelligence and Machine Learning is
transforming Data into Wisdom
Pietro Leo
Executive Architect - IBM Italy CTO for Big Data Analytics & Watson
IBM Academy of Technology Leadership
Head of IBM Italy Center of Advanced Studies
5. 5
You shared
your position
with me and
can guess
your mobility
need.
I can take you
where you
need to be
Just enjoy
your new
experience.
Stay safe as
in your
home
I know
what is
needed for
you, even
before you
order it
Please, come
with me and
stay by me.
I know your
content I can
take care of all
your digital life
12. 12
Image
source:
http://personalexcellence.co/blog/ideal-‐beauty/
City
Lifestyle
ZIPcode
Costal
vs
Inland Marital
status
Generation
Location
Family
Size
Gender
Income
Level
Competitors
Age
Loyalty
&
Card
Activity
Revenue
Size
Life
Stages
Eductation
Legal
status
Sector
Industry
Subscriptions
Date on Site
Wish List
Size of
Network
Check-ins
App usage duration
Number of Apps on Device
Deposits/Withdrawals
Device Usage
Purchase History
Following
Followers
Likes
Number of Hashtags used
History of Hashtags
Search Strings entered
Sequence of visits
Time/Day log in
Time spent on site
Time spent on page
Frequency of Search
Videos Viewed
Photos liked
13. 13
Image
source:
http://personalexcellence.co/blog/ideal-‐beauty/
City
Lifestyle
ZIPcode
Costal
vs
Inland Marital
status
Generation
Location
Family
Size
Gender
Income
Level
Competitors
Age
Loyalty
&
Card
Activity
Revenue
Size
Life
Stages
Eductation
Legal
status
Sector
Industry
Subscriptions
Date on Site
Wish List
Size of
Network
Check-ins
App usage duration
Number of Apps on Device
Deposits/Withdrawals
Device Usage
Purchase History
Following
Followers
Likes
Number of Hashtags used
History of Hashtags
Search Strings entered
Sequence of visits
Time/Day log in
Time spent on site
Time spent on page
Frequency of Search
Videos Viewed
Photos liked
Sentiment
Tone
Euphemisms
Hedonism
Extroversion
Face Recognition
Openess
Colloquialism
Reasoning Strategies
Language Modeling
Dialog
Intent
Latent Semantic Analysis
Phonemes
Ontology Analysis
Linguistics
Image Tags
Question Analysis
Self-transcendent
Affective Status
19. 19
BIG DATA
DATA
WISDOM
Knowledge
Information
Technology is no more
supporting every kind of
private and public
organizations, it is becoming
part of them.
Machine Intelligence
Is becoming the key
ingredient.
Analytics
Cloud Computing
Data Science
Mobile
Social
Digitalization
Technology
Business
Robotics
Artificial Intelligence
Business & Tech NexusThings
20. @pieroleo
Cognitive Computing
scales our wisdom to expand what’s possible.
New Information Technology challenge is now about the
possibility to expand our WISDOM options
Watson
21. @pieroleo
21
Analytic
Systems use
statistical
techniques for
detecting patterns
or detect trends
within data, yield
an understanding
of historical or
current state from
which to draw
conclusions
Text Mining is a class of functions for
parsing and identifying significant words
in language (NLP) as well as
understand the semantic of a textual
content
Cognitive Systems
leverage machine
learning to predict
meaning in features of
human language
(spoken, written, visual)
and related forms of
human reasoning
Multi-Media Mining is a a class of
function for analyzing visual content
such as images or videos
Speech Mining is a class of
functions for analyzing audio
signals including speech to such
as ability Cognitive Solutions
leverage a combination of
cognitive system reasoning
strategies and other analytic and
classical computing techniques to
solve for a complex problem ->
Amplify Human WISDOM in a
specific domain
XXX Mining is class of large
specialized functions for analyzing
“digital representation” in a
specific domain à e.g.,
Bioinformatics, Financial Analytics,
etc.
Capitalize on Digital Data
Machine Learning
is a class of
statistical techniques
that use training
data to recognize
the correlation
between a set of
feature patterns and
outcomes.
It includes also Deep
Learning that is a
rapidly maturing space,
based on neural
network techniques,
that are taught to find
their own features
Emerging Patterns for Artificial Intelligence adoption in Business World
WISDOM
22. @pieroleo
2011
2015
2016 - AlphaGO=4 Lee Se-Dol=1
1997 - IBM=2.5 Kasparov=2.5
1997
AlphaGO uses self-trained net to evaluate
positions and moves on 30M historical
games
DeepBlue uses a hard-coded objective function
written by a human coupled with High
Performance Computing
2016
10
10170
1040
Applying or having wisdom in real world is
not only an AI game
COMPUTING & MATH WISDOM
IBM Watson – Jeopardy!
SEMANTICS
23. @pieroleo
IBM Cognitive Computing by numbers in IBM
45
Countries
100+
Applications
already in market
6.000
Researchers
& Specialists in IBM
8
Languages
Learned by Watson
200
Universities
offering Watson courses
500+
Partners
Powered by Watson
28
API
already available
20
Industries
80.000
Developers
building with Watson
Watson Health
Watson Internet
Of Things
Watson Finantial
Services
3 Industrial Business
Units
24. @pieroleo
24
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
Ecosystems to quick industrialize and scale cognitive systems
are emerging
Watson for Financial
Services
Watson Internet
of Things
IBM Vertical Cognitive Business
Units are emerging blending, in
industry specific platforms,
cognitive layer & specific data
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Ecosystems to quick industrialize and scale cognitive systems are emerging
Ecosystem Cognitive Applications
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
3. 2.Hybrid Cognitive
Frameworks
1.
25. @pieroleo
25
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
Ecosystems to quick industrialize and scale cognitive systems
are emerging
Watson for Financial
Services
Watson Internet
of Things
IBM Vertical Cognitive Business
Units are emerging blending, in
industry specific platforms,
cognitive layer & specific data
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Ecosystems to quick industrialize and scale cognitive systems are emerging
Ecosystem Cognitive Applications
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
3. 2.Hybrid Cognitive
Frameworks
1.
26. @pieroleo
26
IBM Conversation Applications
Watson Marketing
• Watson Real-time Personalization
• Watson Customer Experience
Analytics
• Watson Ads
Watson Commerce
• Watson Commerce Insights
• Watson Content Hub
• Watson Order Optimizer
• Watson Personal Shopper
Watson Supply Chain
• Watson Supply Chain Insights
Watson Work
• Watson Workplace
• Watson Work Services (3 APIs)
Watson Education
• Watson Element for Educators
• Watson Enlight for Educators
• Watson Teacher Advisor
Watson Talent
• Watson Talent Insight
• Watson Career Coach
• Watson Recruitment
• Watson Talent Development
• Watson Virtual Agent for HR
Watson for Financial Services
• Watson Regulatory Compliance
• Watson Client Insight for Wealth
Management
• Watson Customer Insight for
Banking
• Watson Customer Insight for
Insurance
Watson Health
• Watson Health Cloud
• Watson Drug Discovery
• Watson Genomics
• Watson Oncology
1.
….and more
27. @pieroleo
27
IBM Conversation Applications
Watson Marketing
• Watson Real-time Personalization
• Watson Customer Experience
Analytics
• Watson Ads
Watson Commerce
• Watson Commerce Insights
• Watson Content Hub
• Watson Order Optimizer
• Watson Personal Shopper
Watson Supply Chain
• Watson Supply Chain Insights
Watson Work
• Watson Workplace
• Watson Work Services (3 APIs)
Watson Marketing
Watson Education
• Watson Element for Educators
• Watson Enlight for Educators
• Watson Teacher Advisor
Watson Talent
• Watson Talent Insight
• Watson Career Coach
• Watson Recruitment
• Watson Talent Development
• Watson Virtual Agent for HR
Watson for Financial Services
• Watson Regulatory Compliance
• Watson Client Insight for Wealth
Management
• Watson Customer Insight for
Banking
• Watson Customer Insight for
Insurance
Watson Health
• Watson Health Cloud
• Watson Drug Discovery
• Watson Genomics
• Watson Oncology
1.
28. @pieroleo
1-800 Flowers
Live at: https://www.1800flowers.com/gwyn-1800flowers?flws_rd=1 Live at: https://www.thenorthface.com/xps
GWYN (Gifts When You Need), a Watson-powered personal
concierge designed to help customers find the perfect gift
The North Face
A personal Shop Assistant that can drive you to select the
most appropriate Jacket
29. @pieroleo
170,000 personal weather
stations worldwide
2.2 B locations forecasted every
15 minutes.
15 B Weather averages 15B
forecast queries daily.
20 terabytes, every day.
Bring Advanced Weather Insights to Business
Source: https://www.wunderground.com/
33. @pieroleo
When
do
people
want
soup?
Soup
warms
L.A.
up
when
it’s
55°
33
New
Yorkers
enjoy
soup
when
temps
drop
from
50° to
30°
LOS ANGELES NEW YORK CITY
35. @pieroleo
35
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
Ecosystems to quick industrialize and scale cognitive systems
are emerging
Watson for Financial
Services
Watson Internet
of Things
IBM Vertical Cognitive Business
Units are emerging blending, in
industry specific platforms,
cognitive layer & specific data
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Ecosystems to quick industrialize and scale cognitive systems are emerging
Ecosystem Cognitive Applications
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
3. 2.Hybrid Cognitive
Frameworks
1.
37. @pieroleo
Anaphoric Co-referencing
Colloquialism Processing
Content Management -- Versioning
Convolutional Neural Networks
Curation
Deep Learning
Dialog Framing
Ellipses
Embedded Table Processing
Ensembles and Fusion
Entity Resolution
Factoid Answering
Feature Engineering
Feature Normalization
Focus and Spurious Phrase
Resolution
HTML Page Analysis
Image Management
Information Retrieval
Knowledge (Property) Graphs
Knowledge Answering
Knowledge Extraction Annotators
Knowledge Validation and
Extrapolation
Language Modeling
Latent Semantic Analysis
Learn To Rank
Linguistic Analysis
Logical Reasoning Analysis
Logistical Regression
Machine Learning
Multi-Dimensional Clustering
Multilingual training
n-Gram Analysis (word
combinations and distance)
Ontology Analysis
Pareto Analysis
Passage Answering
PDF Conversion
Phoneme Aggregation
Question Analysis
Question-answering Reasoning
Strategies
Recursive Neural Networks
Rules Processing
Scalable Search
Similarity Analytics
Statistical Language Parsing
Support Vector Machines
Syllable Analysis
Table Answering
Visual Analysis
Visual Rendering
Voice Synthesis
These APIs are underpinned by
50 technologies:
2011
2015Source: http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/services-catalog.html
3.
38. @pieroleo
IBM Cognitive Services
1. Watson APIs are
continuously.
2. They are
complemented with
tens of other APIs in
other domains, all
running on ONE
platform.
3. They can mashed
up to build an
infinite number of
cognitive assistants.
2011
2015
Pipeline
39. @pieroleo
39
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
Ecosystems to quick industrialize and scale cognitive systems
are emerging
Watson for Financial
Services
Watson Internet
of Things
IBM Vertical Cognitive Business
Units are emerging blending, in
industry specific platforms,
cognitive layer & specific data
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Ecosystems to quick industrialize and scale cognitive systems are emerging
Ecosystem Cognitive Applications
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
3. 2.Hybrid Cognitive
Frameworks
1.
41. @pieroleo
41
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
Ecosystems to quick industrialize and scale cognitive systems
are emerging
Watson for Financial
Services
Watson Internet
of Things
IBM Vertical Cognitive Business
Units are emerging blending, in
industry specific platforms,
cognitive layer & specific data
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Ecosystems to quick industrialize and scale cognitive systems are emerging
Ecosystem Cognitive Applications
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
3. 2.Hybrid Cognitive
Frameworks
1.