Amazon brings natural language processing, automatic speech recognition, text-to-speech, and neural machine translation technologies within reach of every developer. In this session, learn how you can easily add intelligence to any application with solution-oriented machine learning (ML) services that provide speech, language, and chatbot functionalities. We also share real-world examples of ML in action. See how others are defining and building the next generation of apps that can hear, speak, understand, and interact with the world around us.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Vikram Anbazhagan
Head of Product – Language Tech
BDA302
Build Intelligent Apps with Amazon ML –
Language Services

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Frameworks
&
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Amazon Rekognition Image
Amazon Rekognition Video
Speech:
Amazon Polly
Amazon Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
Amazon confidential
Amazon Machine Learning Stack

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Powerful language capabilities
Amazon Transcribe
Automatic conversion of speech into accurate, grammatically
correct text
Amazon Translate Natural and fluent language translation
Amazon Polly Turn text into lifelike speech using deep learning
Amazon Comprehend Discover insights and relationships in text
Amazon Lex
Conversational interfaces for text-based and voice-based
applications

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Common language use cases
Information Bots
Education
Accessibility
Knowledge Management
Voice of Customer
Applications
Customer Service/
Call Centers
Enterprise
Digital Assistant
Semantic Search
Captioning Workflows
LocalizationPersonalization

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you make your applications
conversational?

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex
A service for building conversational interfaces into any
application using voice and text

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex
Social Intelligence
Personality
Modality
Dynamic
Conversation
• Built-in error handling allows you to manage unexpected scenarios
• Intent chaining can be used to build a conversation flow based on user
input
• Rich formatting capabilities can be leveraged for a more engaging
experience
• Create conversation combining speech and text in the same session
• Select from multiple prompts to give your bot a personality
• Choose from a range of Amazon Polly voices depending on target
audience
• Use AWS Lambda to personalize the conversation based on user’s
social profile
• Context is maintained allowing you to build intelligent conversations

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex – use cases
Informational Bots
Chatbots for everyday consumer requests
Application Bots
Build powerful interfaces to mobile applications
• News updates
• Weather information
• Game scores ….
• Book tickets
• Order food
• Manage bank accounts ….
Enterprise Productivity Bots
Streamline enterprise work activities and improve efficiencies
• Check sales numbers
• Marketing performance
• Inventory status ….
Internet of Things (IoT) Bots
Enable conversational interfaces for device interactions
• Wearables
• Appliances
• Auto ….
Contact Center Bots
Chatbots for customer service IVR
• Account inquiries
• Bill payment
• Service update ….

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you give your applications a
voice?

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly
A text-to-speech service that uses advanced deep
learning technologies to synthesize speech that sounds
like a human voice

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly
• Content creation
• Mobile & desktop applications
• Internet of Things (IoT)
• Education & e-learning
• Telephony
• Game development
Use cases
• 52 Voices across 25 languages
• Lip-syncing & text highlighting
• Fine-grained voice control
• Custom vocabularies
• Available in 14 AWS Regions
Key features

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly: Use cases
Voiced
Notifications
Special Needs
AI Assistant
AI Radio
Announcer
Video
Creation
Amazon Polly
Navigation
Podcasting

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you extract insights from
unstructured text?

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Comprehend
A fully managed and continuously trained service that
helps you extract insights from unstructured text

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Comprehend
Sentiment Entities LanguagesKey phrases Topic modeling
Syntax

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Comprehend: Natural Language Processing
A m a z o n . c o m , I n c . i s l o c a t e d i n
S e a t t l e , WA a n d w a s f o u n d e d
J u l y 5 , 1 9 9 4 b y J e f f B e z o s . O u r
c u s t o m e r s l o v e b u y i n g
e v e r y t h i n g f r o m b o o k s t o
b l e n d e r s a t g r e a t p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m : O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Comprehend: Syntax API
O u r c u s t o m e r s l o v e b u y i n g
e v e r y t h i n g f r o m b o o k s t o
b l e n d e r s a t g r e a t p r i c e s
Token
(word)
Part of
Speech
Customers Noun
Love Verb
Books Noun
Great Adjective
Prices Noun

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Popular Text Analytics use cases
Content Personalization: Customers are using Comprehend NLP output to understand related documents
based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and
recommendations
Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking
search results.
Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in
relational databases, processing data within the data lake (Amazon S3) and then inserting it back into the
data warehouse
Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from
entities and sentiment from social media posts across Twitter and Facebook.

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Text Analytics Workload
Amazon Kinesis
Amazon ES
Amazon Redshift
Amazon EMR
• Semantic
• Rich filtering
• Grouping, trends
• Joining, correlating
• Clustering
• Graph, search
• Near real-time
• Alerts
Amazon S3
Social media, support
Amazon Aurora
Articles, documents

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you make your applications
listen?

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe
A fully managed and continuously trained automatic
speech recognition (ASR) service that takes in audio and
automatically generates accurate transcripts

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe: Automatic speech recognition
Time stamps and
confidence scores
Support for both
regular and telephony
audio
Punctuation
§
Amazon S3
integration
Hello/
Hola
English and Spanish
with more to come
Detect multiple
speakers
Custom
vocabulary

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SYD - Australia
YUL - Canada
Region Launches

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe: Use cases
Call centers Subtitles for
VOD
Broadcast closed
captions
Transcribe
meetings

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Lambda
Amazon S3
Amazon
Athena
Audio Input
Amazon
QuickSight
Amazon
Comprehend
Amazon Transcribe − integration with AWS

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you make your applications
multilingual?

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Translate
A fully managed and continuously trained neural
machine translation service that translates text from
one language to another

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Translate: Features
Translate text input Real-time Translation12 languages + more to come Language detection via
Amazon Comprehend
AWS security standards Available in US EAST (N.
VIRGINIA), US EAST (OHIO),
US WEST (OREGON) &
DUBLIN
Easy to us and integrate via CLI
OR SDKs Cost effective

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Translate Languages
Arabic
Simplified Chinese
French
German
Spanish
Portuguese
Current
Japanese
Traditional Chinese
Italian
Russian
Turkish
Czech

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use for high volume and time-sensitive information
Share of worldwide digital content
• Legal documents
• Healthcare documents
• Advertising materials
Machine translation
• User-authored content
• Text Analytics
• Real-time communication
• Content discovery
Post-edited
machine
translation

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PubNub & Machine Learning Services on
AWS

33. PubNub Confidential © 2017 PubNub Confidential © 2017
Online Experience is Becoming Realtime

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Realtime is becoming Mission Critical
Device
control
Collaboration Updates, triggers,
notifications
✔ ✔ ✔ ✔
Machine Learning
APIs are needed
for realtime apps
Scalability is
critical to effective
realtime?
Consumers
demand 99.999%
reliability
Enterprise-
grade security
is part of life
today

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Realtime Infrastructure-as-a-Service
Rich APIs to power
every realtime
experience
✔
Global replication
for 99.999%
reliability
✔
Managed infrastructure
delivers unlimited
scalability
✔
Multiple layers of
security &
encryption
✔

36. PubNub Confidential © 2017
Over
250 Million
Transactions
Per Minute
Offering
99.999%
Uptime SLAs
With unprecedented Global Scale
330 Million
Unique Monthly
Devices
Over
Delivering
¼ Second
Worldwide Latency
Over
150,000
PubNub
Developers15+Global
Data Centers
Using
1 MillionUsers
in a Chat Room
Supports Over

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Realtime
Collaboration Is
Complex
to Build
? ? ? ?
How do you host
chatbots and
integrate
seamlessly?
How do you
track online
status of your
users?
How do you
reliably convert
text to speech?
How do you reliably
and quickly deliver
messages globally?

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
● Open architecture offers
access to AWS ML services
through PubNub Functions
and lower-level PubNub
JavaScript SDK
● Can program custom logic
in PubNub Network with
Functions PubNub Realtime Network
SDK
Security Data
Persistence
Serverless
Functions
Realtime Connection
to 3rd Party Services
Scale
PubNub Open, Extensible Framework
Customer App

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Joseph McCullough, SVP Product, One Call
Kelly Dyer, CEO, SourceFuse
Kabir Singh Chandhoke, COO, SourceFuse
SourceFuse & One Call

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Who Is SourceFuse?
Strategic Advantages:
● Multi-Domain Expertise
● Lean + Agile
● Innovation & Leading
Edge Tech
What we do:
✓ Innovation for the
Enterprise
✓ Strategy, Roadmapping, &
Digital Transformation
✓ Strategic Development for
Startups
Over 150 developers,
designers, project
managers, domain
experts, and engineers
...across 4 office
locations in the US, the
UK, and India.
A global team of Innovators, Technologists, and Product Builders.
“We love building products and solving big impactful problems with technology”

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
$1.6 B
Annual
Revenue
#1 Market
Position
for all 6
products
Headquarters:
Jacksonville,
Florida
2,800
Employees
Offices in:
New York
New Jersey
California
Missouri
One Call Overview
As a leader in medical cost management in workers compensation – One Call
understands the importance of member safety and timely access to care.
One Call − Who we are

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Diagnostics
Advanced
Radiology
&
Neurodiagnostics
Quality driven
provider network
3,200 centers
2,200 EMG & NCS
physicians
500,000 patients
Physical
Therapy
Referral
management
through rehab life
cycle
Outcomes driven
provider network
24,000 providers
500,000 patients
Dental
Dental claims
management &
patient utilization
management
9,900 providers
8,000 patients
Transport +
Translate
Largest network
of Transportation
& Translation
Nationwide
network of
providers
475,000 transport
appointments
382,000 language
appointments
Home Health
+ Complex
Care
In-house clinicians
National network
12,000 providers
30,000 patients
Equipment +
Devices
Centralized
ordering and
management
10,000 providers
72,000 patients
We understand true benefit management
and our competencies extend beyond transportation.
One Call − What we do

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Americans miss
medical
appointments
every year due to
a lack of reliable
transportation
is spent on
healthcare
related
transportation
each year
Missed medical
appointments
cost the US
healthcare
system more
than $150 billion
each year
3.6
million
$6
billion
$10
billion
The Cost

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Cure for the Common No-Show

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
223,750
rides
8 min.
13 sec.
$24.59 +400
Total Rides Average
ETA
Average
Cost per
Ride
Health clinics
using Relay
today
Relay Ride − Real Customers, Real Impact

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Relay Ride − Architecture

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Relay Ride − Leveraging AWS Polly & Connect

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
This is an automated call from Relay SOLUTIONS
Your transportation has been arranged by OneCall on behalf of
AWS for 07/17/2018 09:00 AM.
You’ll receive the driver details when they’re on the way to pick
you up.
Need additional help? Call 1866835XXXX
Relay Ride − Leveraging Amazon Polly &
Amazon Connect

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
<speak><emphasis level="moderate">
Good <TimeOfDay Greeting> <RiderName>
This is an automated call from Relay SOLUTIONS
<break strength="strong"/>
Your transportation has been arranged by OneCall on behalf of <<org
name>> for <<ride date time>>
<break strength="strong"/>
You’ll receive the driver details when they’re on the way to pick you up
<break strength="x-strong"/>
Need additional help? Call <say-as interpret-
as="digits">1866835XXXX</say-as>
</emphasis></speak>
<speak> <emphasis level="moderate">
Good <TimeOfDay Greeting> <RiderName>
This is an automated call from Relay SOLUTIONS <break
strength="strong"/>
Your Lyft driver JAYME will be arriving in a white Skoda Octavia
with license plate
<say-as interpret-as="digits">LOG89A6</say-as>
to pick you up in 3 minutes <break strength="x-strong"/> Call
driver at <say-as interpret-as="digits">1666835XXXX
</say-as> </emphasis></speak>
Good Morning, Kabir
This is an automated call from Relay SOLUTIONS
Your transportation has been arranged by OneCall
on behalf of AWS for 07/17/2018 09:00 AM.
You’ll receive the driver details when they’re on the
way to pick you up.
Need additional help? Call 1866835XXXX
Good Morning, Kabir
This is an automated call from Relay SOLUTIONS
Your Lyft driver JAYME will be arriving in a white
Skoda Octavia with license plate LOG89A6 to pick
you up in 3 minutes
Call driver at 1666835XXXX
Relay Ride − Personalized Automated Calls

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
10%
improvement
in schedule
adherence
20%
rider
satisfaction
Cost savings
Relay Ride − Results

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!