Artificial Intelligence services on the AWS cloud bring machine learning technologies such as image recognition and computer vision within reach of every developer.In this session, you will be introduced to AWS AI services for developers and learn how to use one of them, Amazon Rekognition, to add new capabilities to your applications.

1. © 2019, Amazon Web Services, Inc. or its Affiliates.
Enriching your App with Image
Recognition and AWS AI Services
Boaz Ziniman, Technical Evangelist
Amazon Web Services
@ziniman
ziniman

2. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
• The History of Image Recognition
• Introduction to the AWS AI Services
• Amazon Rekognition and the different APIs
• Use Cases
• Demos
Agenda

3. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
• Classification, Detection, segmentation
• Face Detection
• Face Verification
• Face Recognition
• Text Detection
Image Processing

4. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Convolutional Neural Networks (CNN)
Le Cun, 1998: handwritten digit recognition, 32x32 pixels
https://devblogs.nvidia.com/parallelforall/deep-learning-nutshell-core-concepts/

5. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Our deep experience with AI/ML
differentiates our approach
Product
recommendation
engine
Robot-enabled
fulfillment
centers
New
product
categories
Amazon has invested in AI/ML since our inception, and we
share our knowledge and capabilities with our customers
20181995
Natural language
processing-supported
contact centers
ML-driven supply
chain and
capacity planning
Checkout-free
shopping
using deep learning

6. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Our mission at AWS
Put machine learning in the hands
of every developer

7. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
A I S E R V I C E S
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D
& C O M P R E H E N D
M E D I C A L
L E XR E K O G N I T I O N
V I D E O
Vision Speech Chatbots
A M A Z O N
S A G E M A K E R
B U I L D T R A I N
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
D E P L O Y
Pre-built algorithms & notebooks
Data labeling (G R O U N D T R U T H )
One-click model training & tuning
Optimization (N E O )
One-click deployment & hosting
M L S E R V I C E S
F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e
E C 2 P 3
& P 3 d n
E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I C
I N F E R E N C E
Reinforcement learningAlgorithms & models ( A W S M A R K E T P L A C E
F O R M A C H I N E L E A R N I N G )
Language Forecasting Recommendations
The Amazon ML stack: Broadest & deepest set
of capabilities

8. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon SageMaker
Machine learning for every developer and data scientist.

9. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon SageMaker: Build, train, and deploy ML
1
2
3
1
2
3

10. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
A I S E R V I C E S
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D
& C O M P R E H E N D
M E D I C A L
L E XR E K O G N I T I O N
V I D E O
Vision Speech Chatbots
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
Language Forecasting Recommendations
Put AI to work for your business

11. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition
Easily add intelligent image and video analysis
to your applications.

12. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition:
Deep Learning-Based Image and Video Analysis

13. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition Benefits
Low cost
Your data
is your ownServerless
Rapid
integration
State of the
art capabilities
Continuous
improvement

14. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition Image
Object and scene
detection
Facial
analysis
Face
recognition
Text in
image
Unsafe image
detection
Celebrity
recognition
Face comparison

15. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Object & Scene Detection

16. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Smiling?
Facial Analysis

17. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Crowd Detection – up to 100 faces

18. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Facial Search

19. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Explicit Nudity
Nudity
Graphic Male Nudity
Graphic Female Nudity
Sexual Activity
Partial Nudity
Suggestive
Female Swimwear or Underwear
Male Swimwear or Underwear
Revealing Clothes
Image Moderation

20. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Celebrity Recognition

21. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Text in Image

22. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
DEMO
https://github.com/ziniman/aws-rekognition-demo

23. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition Video
Deep Learning-based video analysis service

24. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Video Analysis

25. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman

26. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Scaling video indexing
C-SPAN uses Amazon Rekognition to
automatically index video news footage
for search. With Rekognition, C-SPAN
reduced indexing time per video from 1
hour to 20 minutes and uploaded 97,000
images in under 2 hours.

27. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Real-time
identity verification
Aella Credit uses Amazon Rekognition to
analyze images to verify an individual’s identity in
real-time without human intervention, allowing it
to provide instant loans to eligible customers
through its mobile app.

28. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
boazz: ~/ aws rekognition detect-labels
--image '{"S3Object":{"Bucket":"demos.ziniman.com","Name":"photos/reko.jpg"}}’
{
"Labels": [
{
"Confidence": 99.14048767089844,
"Name": "Human"
},
{
"Confidence": 99.1404800415039,
"Name": "People"
},
{
"Confidence": 99.14048767089844,
"Name": "Person"
}……
Rekognition API Example

29. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
boazz: ~/ aws rekognition detect-faces
--image '{"S3Object":{"Bucket":"demos.ziniman.com","Name":"photos/reko.jpg"}}'
--attributes "ALL”
{
"FaceDetails": [
{
....
"Gender": {
"Confidence": 99.9211654663086,
"Value": "Male"
},
"AgeRange": {
"High": 52,
"Low": 35
},
....
Rekognition API Example

30. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Rekognition Lambda Python Example

31. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Demo – https://reko.ziniman.com
https://github.com/ziniman/aws-serverless-website-photo-tagging

32. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
Amazon
Cognito
JavaScript
SDK
https://reko.ziniman.com
• Write images into Images Bucket
• Read list of images
• Read data from DynamoDB
Static Site
Bucket
Images Bucket
Lambda
Function
Role
Amazon
DynamoDB
Amazon
CloudFront
Amazon
Rekognition

33. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
JavaScript
SDK
• Read image from Images Bucket
• Execute Rekognition detect_moderation_labels()
• Execute Rekognition detect_labels()
• Write data to DynamoDB• Write images into Images Bucket
• Read list of images
• Read data from DynamoDB
Amazon
Cognito
Static Site
Bucket
Images Bucket
Lambda
Function
Amazon
DynamoDB
Amazon
CloudFront
Amazon
Rekognition
Role
Role
Lambda
Function
Amazon API
Gateway

34. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
JavaScript
SDK
Static Site
Bucket
Images Bucket
Amazon
DynamoDB
Amazon
CloudFront
Lambda
Function
Amazon
RekognitionAmazon API
Gateway

35. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
JavaScript
SDK
[
{"photo_id": "IMG_2018920-213126787.jpg”},
{"photo_id": "IMG_2018920-213320377.jpg"}
]
Static Site
Bucket
Images Bucket
Amazon
DynamoDB
Amazon
CloudFront
Lambda
Function
Amazon
RekognitionAmazon API
Gateway

36. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
• https://aws.amazon.com/rekognition/
• https://aws.amazon.com/blogs/machine-learning/
• https://aws.amazon.com/blogs/machine-learning/classify-your-own-
images-using-amazon-sagemaker/
• https://github.com/ziniman/aws-rekognition-demo
• https://github.com/ziniman/aws-serverless-website-photo-tagging
Where to Start?

37. © 2019, Amazon Web Services, Inc. or its Affiliates.
Thank You!
Boaz Ziniman, Technical Evangelist
Amazon Web Services
@ziniman
ziniman