1.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Chris Fregly
Developer Advocate AI/ML
Amazon Web Services
Human-in-the-Loop Active
Learning with Augmented AI

2.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Who Am I?
Based in San Francisco
Meetup Organizer,Advanced SageMaker and Kubeflow Meetup:
https://meetup.com/Advanced-Kubeflow/ (12,000+ Members)
O’Reilly Author, Data Science on AWS: https://datascienceonaws.com
Former Engineer at Netflix (Video Streaming) and Databricks (Spark Streaming)

3.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Agenda
Why Choose AWS for AI and Machine Learning?
Amazon Managed Services forActive Learning and AugmentedAI (A2I)
DEMOs!
Amazon Customer Reviews Dataset
Train aText Classification Model with Amazon Comprehend
Deploy the Model and Make Predictions on Sample Amazon Reviews
Create AugmentedAIWorkflow for Humans to Fix Unconfident Predictions

4.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Why Choose AWS for AI and
Machine Learning?

5.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Our mission at AWS
Put machine learning in the
hands of every developer

6.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Why Choose AWS for AI and Machine Learning?
200+ new features and services launched in
2019 alone
Solutions for everyone from ML scientists to
application developers
Support all three of the major frameworks
Broadest and
deepest set of AI
and ML services
Single IDE for the entire ML workflow
At least 54% lowerTCO
Up to 70% cost reduction
in data-labeling
Up to 90% cost reduction with managed spot
training
Accelerate your
adoption of ML
with SageMaker
Built on the most
comprehensive cloud platform
Highly secure, reliable, fully featured data store
The strongest set of compute, storage, security,
database, and analytics capabilities to build upon
85%TensorFlow in the cloud runs on AWS

7.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Amazon SageMaker has Tens of Thousands of Customers

8.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Powered by
Customer References – National Football League

9.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Customer References – Bundesliga
https://www.businesswire.com/news/home/20200526005205/en/Amazon-Web-Services-Bundesliga-Deliver-Real-Time

10.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Amazon Managed Services
for AI and Machine Learning

11.
© 2020, Amazon Web Services, Inc. or its Affiliates.
The AWS AI and Machine Learning Stack
Broadest and most complete set of AI and Machine Learning capabilities
VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS
Ground
Truth
AWS
Marketplace
for ML
Neo Augmented
AIBuilt-in
algorithms
Notebooks Experiments Processing
Model
training &
tuning
Debugger Autopilot
Model
hosting
Model Monitor
Deep Learning
AMIs & Containers
GPUs &
CPUs
Elastic
Inference
Inferentia FPGA
Amazon
Rekognition
Amazon
Polly
Amazon
Transcribe
+Medical
Amazon
Comprehend
+Medical
Amazon
Translate
Amazon
Lex
Amazon
Personalize
Amazon
Forecast
Amazon
Fraud Detector
Amazon
CodeGuru
AI SERVICES
ML SERVICES
ML FRAMEWORKS & INFRASTRUCTURE
Amazon
Textract
Amazon
Kendra
Contact Lens
For Amazon Connect
SageMaker Studio IDE
Amazon SageMaker
DeepGraphLibrary

12.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Amazon Augmented AI
Easily build workflows required for human review of predictions
Supports “consensus” decisions among multiple reviewers
Easily implement
human review
workflows
Reduce time to market
with pre-built workflows
and UIs
Multiple workforce
options
Integrate with
your custom ML
models
Pre-built algorithms
to
increase accuracy

13.
© 2020, Amazon Web Services, Inc. or its Affiliates.
How Amazon Augmented AI Works
Client application
sends input data
AWS AI Service or
custom ML model
makes predictions
Results stored to
your S3
1 2
6
4 Low confidence predictions
sent for human review
3
High-confidence predictions
returned immediately to client
application
5 Reviews consolidated
usingA2I answer
consolidation algorithms
ClientApplication

14.
© 2020, Amazon Web Services, Inc. or its Affiliates.
• Reduce data labeling costs by up to 70%
• Access labelers through Amazon Mechanical Turk, Amazon
approved vendors, or use private human labelers
• Achieve accurate results quickly
Build highly accurate training datasets using humans and machine learning
Humans start the labeling process,GroundTruth uses ”active learning” to learn an auto-
labeling model to augment human labeling
The GroundTruth auto-labeling model improves with more data
Amazon SageMaker GroundTruth

15.
© 2020, Amazon Web Services, Inc. or its Affiliates.
How Amazon SageMaker GroundTruthWorks

16.
© 2020, Amazon Web Services, Inc. or its Affiliates.
DEMOs!
https://github.com/data-science-on-aws/workshop
Amazon Customer Reviews Dataset
(150+ Million Reviews)
https://s3.amazonaws.com/amazon-reviews-pds/readme.html

17.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Machine Learning Solutions Lab

18.
© 2020, Amazon Web Services, Inc. or its Affiliates.
Thank you!
Chris Fregly @cfregly
https://data-science-on-aws/workshop
https://linkedin.com/in/cfregly/