Build Smarter Enterprise Apps with AI, AR & VR on AWS

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Build Smarter Enterprise
Apps with AI, AR & VR on
AWS
Dean Samuels
Head of Solutions Architecture
Amazon Web Services – Hong Kong & Taiwan

Agenda
AWS Artificial Intelligence Services
Augmented & Virtual Reality (AR & VR)
Building Intelligent Applications…

Perform tasks which normally
require human intelligence and
the ability for a computer system
to adapt to humans and interact
in a natural manner, rather than
humans adapting to a system

“By 2022, task-level intelligent
apps that augment human efforts
will account for 30% of the
enterprise apps market”
-- IDC on Cognitive/AI Systems

A long heritage of machine learning at Amazon
Personalized
recommendations
Inventing entirely
new customer
experiences
Fulfillment
automation and
inventory
management
Drones Voice driven
interactions

Put machine learning
in the hands of every
developer and data
scientist
ML @ AWS:
OUR MISSION

The Amazon Machine Learning Stack
F R A M E W O R K S
P L A T F O R M S
Rekognition Rekognition
Video
Polly Transcribe Translate Comprehend Lex
A P P L I C A T I O N S E R V I C E S
Amazon SageMaker Amazon Mechanical Turk

Agenda
Where to Next
Building Intelligent Applications

How do you make your
applications conversational?

Amazon Lex
A service for building conversational interfaces into
any application using voice and text

Amazon Lex
Social Intelligence
Personality
Modality
Dynamic
Conversation
• Built-in error handling allows you to manage unexpected scenarios
• Intent chaining can be used to build a conversation flow based on user
input
• Rich formatting capabilities can be leveraged for a more engaging
experience
• Create conversation combining speech and text in the same session
• Select from multiple prompts to give your bot a personality
• Choose from a range of Amazon Polly voices depending on target
audience
• Use AWS Lambda to personalize the conversation based on user’s
social profile
• Context is maintained allowing you to build intelligent conversations

Amazon Lex – use cases
Informational Bots
Chatbots for everyday consumer requests
Application Bots
Build powerful interfaces to mobile applications
• News updates
• Weather information
• Game scores ….
• Book tickets
• Order food
• Manage bank accounts ….
Enterprise Productivity Bots
Streamline enterprise work activities and improve efficiencies
• Check sales numbers
• Marketing performance
• Inventory status ….
Internet of Things (IoT) Bots
Enable conversational interfaces for device interactions
• Wearables
• Appliances
• Auto ….
Contact Center Bots
Chatbots for customer service IVR
• Account inquiries
• Bill payment
• Service update ….

How do you give your
applications a voice?

Amazon Polly
A text-to-speech service that uses advanced deep
learning technologies to synthesize speech that
sounds like a human voice

Use cases
• Content creation
• Mobile & desktop applications
• Internet of Things (IoT)
• Education & e-learning
• Telephony
• Game development
Amazon Polly
Key features
• 52 Voices across 25 languages
• New: Mandarin Support
• Lip-syncing & text highlighting
• Fine-grained voice control
• Custom vocabularies
• Available in 14 AWS Regions

Amazon Polly: Use cases
Voiced
Notifications
Special Needs
AI Assistant
AI Radio
Announcer
Video
Creation
Amazon Polly
Navigation
Podcasting

““AI simply has to be part of the fabric of any modern
app from this point forward. It makes sense to work
with existing best-in-class AI services instead of trying
to invent them yourself, so it’s just tremendous that
AWS makes them available for us to just plug into.
Astrobot Voice Makes Email More
Efficient by Using Amazon Lex
To help workplace teams make
their communications more
effective and less time-consuming,
Astro wanted to build a voice
assistant for its Astro email app.
Astrobot Voice uses Amazon Lex
to provide high-quality capabilities
for speech recognition and
language understanding. The
Astro email app also uses Amazon
Aurora and Amazon S3.
• Built and deployed an enterprise-
grade production application
feature in only six weeks
• Needs only one employee to
manage server operations for an
application available on five
platforms
• Tripled new user signups the first
week Astrobot Voice was
available
SolutionChallenge Benefits
Andy Pflaum, Cofounder & Chief Executive Officer, Astro
Company: Astro
Industry: Computer Software &
Internet Software
Country: United States
Employees: 21
Website: www.helloastro.com
About Astro
Astro enables workplace teams to
focus on what’s most important by
using machine learning to make their
communications more effective.
Founded in 2015 and based in Palo
Alto, California, the company raised
$10 million in its Series A venture-
capital round.

How do you extract insights
from unstructured text?

Amazon Comprehend
A fully managed and continuously trained service
that helps you extract insights from unstructured text

Amazon Comprehend
Sentiment Entities LanguagesKey phrases
Topic
modeling
Syntax

Amazon Comprehend: Natural Language Processing
A m a z o n . c o m , I n c . i s l o c a t e d
i n S e a t t l e , W A a n d w a s
f o u n d e d J u l y 5 , 1 9 9 4 b y J e f f
B e z o s . O u r c u s t o m e r s l o v e
b u y i n g e v e r y t h i n g f r o m
b o o k s t o b l e n d e r s a t g r e a t
p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m : O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h

Amazon Comprehend: Syntax API
O u r c u s t o m e r s l o v e b u y i n g
e v e r y t h i n g f r o m b o o k s t o
b l e n d e r s a t g r e a t p r i c e s
Token
(word)
Part of
Speech
Customers Noun
Love Verb
Books Noun
Great Adjective
Prices Noun

Popular Text Analytics use cases
Content Personalization: Customers are using Comprehend NLP output to understand related documents
based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and
recommendations
Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking
search results.
Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in
relational databases, processing data within the data lake (Amazon S3) and then inserting it back into the
data warehouse
Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from
entities and sentiment from social media posts across Twitter and Facebook.

applications listen?

Amazon Transcribe
A fully managed and continuously trained automatic
speech recognition (ASR) service that takes in audio
and automatically generates accurate transcripts

Amazon Transcribe: Automatic speech
recognition
Time stamps and
confidence scores
Support for both
regular and
telephony audio
Punctuation
§
Amazon S3
integration
Hello
/Hola
English and
Spanish with
more to come
Detect multiple
speakers
Custom
vocabulary

Amazon Transcribe: Use cases
Call
centers
Subtitles for
VOD
Broadcast closed
captions
Transcribe
meetings

AWS Lambda
Amazon S3
Amazon
Athena
Audio Input
Amazon
QuickSight
Amazon
Comprehend
Amazon Transcribe: Integration with AWS

applications multilingual?

Amazon Translate
A fully managed and continuously trained neural
machine translation service that translates text from
one language to another

Amazon Translate: Features
Translate text input Real-time Translation12 languages + more to
come
Language detection via
Amazon Comprehend
AWS security standards Available in US EAST (N.
VIRGINIA), US EAST
(OHIO), US WEST
(OREGON) & DUBLIN
Easy to us and integrate via
CLI OR SDKs Cost effective

Translate Languages
Arabic
Simplified Chinese
French
German
Spanish
Portuguese
Current
Japanese
Traditional Chinese
Italian
Russian
Turkish
Czech

Use for high volume and time-sensitive information
Share of worldwide digital content
• Legal documents
• Healthcare documents
• Advertising materials
Machine translation
• User-authored content
• Text Analytics
• Real-time communication
• Content discovery
Post-edited
machine
translation

Powerful language capabilities
Amazon Transcribe
Automatic conversion of speech into accurate,
grammatically correct text
Amazon Translate Natural and fluent language translation
Amazon Polly Turn text into lifelike speech using deep learning
Amazon Comprehend Discover insights and relationships in text
Amazon Lex
Conversational interfaces for text-based and voice-based
applications

Agenda
Where to next
Building Intelligent Applications…

Let’s change how we communicate
Real
Environment
Mixed
Reality
Augmented
Virtuality
Virtual
Environment
Augmented
Reality

What’s it take to build an AR/VR app?
Developer
has idea
Download &
Install 3D
Engine
Install device
SDK
Register on
platform
Install
platform
SDK
Develop
application
Submit for
Approval
Publish
Application
Customer
finds app on
store
Customer
hits
purchase
button
Customer
waits for
download
Customer
uses
application

Browser Based Augmented Reality
AR.js is fast. It can run
scenes at 60 fps even
on older phones
FAST
Get your users running
your app as soon as
they can. No install!
IMMEDIATE
Open source, JavaScript framework for building web based
Augmented Reality applications.

Browser Based Augmented Reality

Agenda
Use Cases & Reference Architectures
Building Intelligent Applications

Improving Contact Centers With Artificial Intelligence
Amazon
Connect
Amazon
Lex
Amazon
Transcribe
TRANSCRIPT
Analytics
Amazon
Comprehend
Channel synthesis
N E W
Syntax Identification
N E W

Improving Voice Of Customer Analytics With Artificial
Intelligence
Amazon
Translate
Sentiment, entities,
key phrases
Amazon
Comprehend
SOCIAL
MEDIA
and
SUPPORT
CHANNEL
Amazon
S3
Amazon
Quicksight
Amazon
Athena
N E W
24 language pairs

Moderate Content for Viewers using Artificial Intelligence
Amazon S3
1. Store Video and Images
Media Files AWS Lambda
Amazon
Rekognition
3. Detect Unsafe
Content.
4. Store information and
confidence scores on
DynamoDB.
DynamoDB
AWS Lambda
5. Retrieve filtered
content based on the
moderation defined.
API Gateway
Aws Elemental
MediaConvert
2. Convert convert
the ts file to mp4 and
store on S3.

Automatically Index Your Media Library Content with AI
Amazon S3 Face collectionRekognition
1. Store images of recognized people 2. Index individuals into a collection
Recognition and pathing of on-screen persons
Amazon S3 Rekognition Video
3. Store video files
4. Understand movement
of persons on screen and
recognize individual faces
Videos AWS Lambda
7. Summarize Info
on screen detail
DynamoDB
API Gateway
6. Retrieve additional
person’s info
5. Face Match,
analysis and Label
Detection

Scan the QR code on your badge and complete the online
survey to redeem an AWS passport pouch at the registration
desk after 3pm.
YOUR FEEDBACK IS IMPORTANT TO US!

Build Smarter Enterprise Apps with AI, AR & VR on AWS

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Build Smarter Enterprise Apps with AI, AR & VR on AWS

Semelhante a Build Smarter Enterprise Apps with AI, AR & VR on AWS (20)

Mais de Amazon Web Services

Mais de Amazon Web Services (20)

Build Smarter Enterprise Apps with AI, AR & VR on AWS