Amazon Alexa is Amazon’s cloud-based voice service and the brain behind tens of millions of devices enabling new customer experiences across many devices at home, work, in the car, and on the go. As a developer, you can build capabilities, or skills, that make Alexa smarter and make everyday tasks faster, easier, and more delightful for customers to fundamentally improve the way people will interact with technology. In this workshop you will learn how to build your first voice skill with Amazon Alexa. We will cover how to build an Alexa skill, utilise AWS services such as AWS Lambda and Amazon DynamoDB, mimic human behaviour with your Alexa skill, and test and publish a skill. You’ll also walk out of the workshop with tips on how to make your Alexa skill more engaging to customers with voice user design best practices. This workshop requires a laptop and administrative access to your own AWS account.

1. S U M M I T
SYDNEY

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Creating voice experiences with
Amazon Alexa Skills: Idea to testing
Azi Farjad
Alexa Developer Evangelist
Amazon Alexa Skills

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
1970s 1980s 1990s PRESENT2000s
CharacterMode
GUI
Web
Mobile
VUI
This magic moment

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Alexa getting smarter all the time
Introducing Amazon Echo featuring Amazon Alexa

5. Available in Australia

6. and growing every day

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Alexa Skills Store

9. When does it make sense to
build your own Alexa skill for
your customers?

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Choose Voice when it is…
EASIER
MORE
NATURAL
FASTER

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Choose Voice when it…
SURPRISES
DELIGHTS
ADDS VALUE

12. Own a
moment

13. “Alexa, ask Tide about ink stains.”

14. “Alexa, open dog feeder.”

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Identifiably Australian
Petrol Check Australia Coastalwatch Bin Reminder

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Voice first games
Magic door Yes SireMusic Song Quiz

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Alexa in the kitchen?
Alexa in the lounge room?
Alexa in the bedroom?
Alexa in the study?
Think winnable locations

18. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Creating an Alexa Skill
Voice User Interface Programming Logic
+
developer.amazon.com aws.amazon.com

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Wake word
detection
Beam forming
Visual
Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Request
Response
Alexa Skills Kit: Signal processing

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Response
Visual
Utterances
Intents
Alexa Skills Kit: Utterances into intents

22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Utterances and intents
Alexa, ask Sydney Guide to recommend attraction
wake word utteranceinvocation namelaunch

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Utterances and intent
Recommend an attraction
utterance
AttractionIntent
intent

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AttractionIntent
to find an
attraction
a good
place to
visit
where to
go
Utterances
Intent
Speaking with Alexa

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Intent and slot
Recommend an attraction within four kilometers
AttractionIntent
slot
{distance: “4”}
slot value
Alexa, ask Sydney Guide
utterance
intent

26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Response
Visual
Audio
Intents
Alexa Skills Kit: Requests and responses

27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Your Service
Text to Speech
SSML, streaming audio
Machine Learning
Natural Language
Understanding
Speech Recognition
Response
Visual
Audio
Intents
Alexa Skills Kit: Output

28. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Speech Synthesis Markup Language

29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
SSML
<speak>
This morning when I woke up to come to summit,
<prosody rate="x-slow">
I spoke quite slowly until I had my coffee.
</prosody>
<prosody volume="x-loud">
Then I felt alive.
</prosody>
</speak>

30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Speechcons
Positives Negatives
All righty Argh
Bada bing bada boom Bah humbug
Huzzah Darn
Wowza Oh dear

31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Sound effects
<speak>
This is Alexa's regular speech, followed by the sound effect
"bear groan roar (1)".
<audio src='https://s3.amazonaws.com/ask-
soundlibrary/animals/amzn_sfx_bear_groan_roar_01.mp3’/>
</speak>

32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon Polly
<speak>
Welcome to Car-Fu.
<voice name="Celine">
<lang xml:lang="fr-FR">
Bienvenue à Car-Fu
</lang>
</voice>
You can order a ride, or request a fare estimate. Which will it be?
</speak>

33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Wide top level UI, not nested menus
A
B
C
D
A B C E
D

34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Example: Food re-ordering skill
Main Menu
Search
Change
Something
Change Pickup
Method
Change
Location
Place order
Change Order
Item
!

35. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
utterance
situation
response
prompt
The core interaction – a turn

37. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Alexa, ask Hello buddy
wake word utteranceinvocation namelaunch
to say hi
“Hi!”

39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Utterances
Intent
SayHiIntent
Say
hi
Hi
Hello

40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Voice User Interface Programming Logic
+
developer.amazon.com aws.amazon.com

41. SayHiIntent
Sayhi
Hello
Hi const SayHiIntentHandler = {
canHandle(handlerInput) {
return handlerInput.requestEnvelope.request.type ===
'IntentRequest'
&& handlerInput.requestEnvelope.request.intent.name
=== ‘SayHiIntent’;
},
handle(handlerInput) {
const speechText = ‘Hi!';
return handlerInput.responseBuilder
.speak(speechText)
.withSimpleCard('Hello World', speechText)
.getResponse();
},
};

42. const SayHiIntentHandler = {
canHandle(handlerInput) {
return handlerInput.requestEnvelope.request.type ===
'IntentRequest'
&& handlerInput.requestEnvelope.request.intent.name
=== ‘SayHiIntent’;
},
handle(handlerInput) {
const speechText = ‘Hi!';
return handlerInput.responseBuilder
.speak(speechText)
.withSimpleCard('Hello World', speechText)
.getResponse();
},
};
SayHiIntent
Sayhi
Hello
Hi

43. const SayHiIntentHandler = {
canHandle(handlerInput) {
return handlerInput.requestEnvelope.request.type ===
'IntentRequest'
&& handlerInput.requestEnvelope.request.intent.name
=== SayHiIntent’;
},
handle(handlerInput) {
const speechText = ‘Hi!';
return handlerInput.responseBuilder
.speak(speechText)
.withSimpleCard('Hello World', speechText)
.getResponse();
},
};
SayHiIntent
Sayhi
Hello
Hi

44. const SayHiIntentHandler = {
canHandle(handlerInput) {
return handlerInput.requestEnvelope.request.type ===
'IntentRequest'
&& handlerInput.requestEnvelope.request.intent.name
=== ‘SayHiIntent’;
},
handle(handlerInput) {
const speechText = ‘Hello! What is your name?’;
const repromptText = ‘Can I have your name?';
return handlerInput.responseBuilder
.speak(speechText)
.reprompt(repromptText)
.withSimpleCard('Hello World', speechText)
.getResponse();
},
};
SayHiIntent
Sayhi
Hello
Hi

45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Order matters
The first handler that returns true will handle the request
Who can handle this situation?
Not me
I can Me!

46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
One-shot invocation
The user will give an utterance,
providing values for each slot
and then the request will be
fulfilled
Dialogue types

47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
One-shot skill
return handlerInput.responseBuilder
.speak(‘Hi!’)
.getResponse();

48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Multi-turn dialogue
The user will be guided through
one or more intents to provide
the slot values in a
conversation
Dialogue types

49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Conversational skill: continue listening
return handlerInput.responseBuilder
.speak(‘Hi! What is your name?’)
.reprompt(‘Can you tell me your name?');
.getResponse();

50. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

51. “What is your name?”
Alexa, ask Hello buddy
wake word utteranceInvocation namelaunch
to say hi
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

52. utterance
My name is Azi
“Nice to meet you Azi.”
slot
“What can I do for you?”
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

53. “Nice to meet you Azi.”
utterance
My name is Azi
slot
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

54. utterance
Stop
“Good bye Azi.”
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

55. utterance
Stop
“Good bye.”
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

56. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

57. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
github.com/alexa/skill-sample-nodejs-fact
Alexa, ask Space Facts to tell me a fact
Fact Skill tutorial

58. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

59. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Remembering after session ends
• Short term memory
• Long term memory

60. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Function code is stateless
MyColourIntent
• colour : blue
“I heard you like blue!”
WhatIsMyColourIntent
“I don’t know your
favorite colour, sorry”

61. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Set and get session attributes to remember
“I heard you like blue!”
{color: ”blue”}
WhatIsMyColourIntent
{colour: ”blue”}
“Your colour is blue”
{color: ”blue”}
SET
GET
MyColourIntent
• colour : blue

62. Set and get persistent attributes for long term memory
MyColourIntent
• colour : blue
“I heard you like blue!”
{colour: ”blue”}
AMAZON
.StopIntent
{colour: ”blue”}
“Goodbye”
{colour: ”blue”}
WhatIsMyColour
Intent
“Your colour is blue”
{colour: ”blue”}

63. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon DynamoDB
One record per skill User
• Primary Key : userId
• Persistent attributes {}

64. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon DynamoDB: grant permissions
AWS IAM Console
Roles
• lambda_basic_execution
Add Policy: DynamoDBFullAccess

65. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
ask-sdk : Interceptors
All Intents Intent Handler() {
}
RequestInterceptor() {
// initialize
session
}
ResponseInterceptor() {
// sanitize output
// save, cleanup
}
1.
2.
3.

66. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
In-Skill purchases

67. Web to Mobile to Voice

68. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

69. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Visual design is constrained

70. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Voice design is unconstrained
Yes
Yeah
Uh huh
SureWhy not?

71. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Bartender skill

72. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
I’ll have a whiskey
Give me a whiskey
Whiskey
Whiskey please
Whiskey for me
Serve up a whiskey
Pass me a whiskey
Intent
ServeDrink
Utterances and intents

73. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
{drink} Synonyms
Whiskey
Johnnie Walker, WhistlePig Boss
Hog, Bushmills
Tequila Don Julio, Ocho
Beer
Draft, cold one, libation, brewskie,
oat soda, cerveza, barley pop
Water
H2o, drink,
still gin and tonic hold the gin
Slots and entity resolution
I’ll have a {drink}
Give me a {drink}
{drink}
{drink} please
{drink} for me
Serve up a {drink}
Pass me a {drink}

74. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

75. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Tailored over time

76. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Highly personalised
“Alexa, launch Travel Buddy”
“Welcome back, Azi! You were last here nine days ago. Since
then I have added one new feature. You can now ask for
Travel Tips.

77. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
To grab the context use
Persistence
Goodbye Azi!
alexa.design/standout

80. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
People don’t only use one greeting
Hey!
Hi!
How’s it
going?
Hello!
Skills shouldn’t either!

81. Fresh content
“Alexa, Stop”
Boring:
“Good bye.”
Add Variety:
“Catch you next time”
“See you on the flip
side”
"AMAZON.StopIntent": function () {
var speechText = getRandomGoodbyeMessage();
this.response.speak(speechText);
this.emit(":responseReady");
},
function getRandomGoodbyeMessage()
{
var messages = ["Goodbye!",
"Buh bye!",
"See you on the flip side!",
"Have fun storming the castle!",
"See you later alligator!",
"Catch you next time!",
"After while, crocodile!"];
var random = getRandom(0, messages.length-1);
return messages[random];
}

82. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

83. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Wide top level UI, not nested menus
A
B
C
D
A B C E
D

84. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The first time storyboard
Launch
I don’t
know
NSW
first time
Every day
need
more info
No
problem
State?
enough
info
Nice!
UNSWWhere?

85. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The 5th time storyboard
Launch 4 of 5 Engineer
5 time
streak
Great!
School
assigned
Glad you
liked it
Degree?
enough
info
That helps
CSEHow was..

86. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The disrupted storyboard
Launch 2 of 5 Engineer
5 time
streak
Great!
School
assigned
Let’s keep
looking
Size?
enough
info
Ok
ASUHow was..

87. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Source: BBC Prototyping for Voice - bit.ly/bbc-vu
Test the interaction

88. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

89. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Skill management API – ASK CLI
Command Line Interface
• Includes AWS CLI
• Requires Node.JS 6.0
alexa.design/cli
ASK CLI

90. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deploying a skill – manual process
Invocation Name
Language Model
• Intents
• Slots
• Samples
Publishing Details
Web service code
• index.js
• helpers.js
• node_modules
developer.amazon.com aws.amazon.com

91. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deploying a skill with ASK CLI
developer.amazon.com aws.amazon.com

92. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
• Cards
Prepare small and large card IMG, host online
• Echo Show/Spot display templates
Select best template
Prepare image & background blur image
Skills using Display

93. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
How do we get the full user profile?
Alexa account linking
Requires :
• Existing user directory with oauth service
• Users to setup account and enter
credentials

94. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Minimise friction
• Location permission – address or city
• Customer contact details – name, mobile & email

95. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Sending information with TXT and Email
Summarise interaction
Provide links to:
• Encyclopedia page
• Product purchase page

96. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Sending information
• Links continue the session
• Easier to shop and buy

97. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Alexa Reminders
Reminders API– Make Alexa wake up and announce
Reminder:
Your Chemistry exam begins in two
hours in room 312

98. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Optimise and improve

99. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

100. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Identifiably Australian/New Zealander

101. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Identifiably Australian
Petrol Check Australia Coastalwatch Bin Reminder

102. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Voice First Games
Magic door Yes SireMusic Song Quiz

103. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
alexa.design/AWScredits
• $100 in credits when you publish your first skill
• Additional $100/month if your skill incurs AWS
usage charges
Build and host most skills for free
AWS promotional credits

104. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

105. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Additional resources
alexa.design/tutorials
github.com/alexa
twitch.tv/amazonalexa
developer.amazon.com/alexa-skills-kit/anz
alexa.uservoice.com

106. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
developer.amazon.com/ale
xa-skills-kit/anz/alexa-
developer-skill-promotion
Incentives for Alexa Skill Builders

107. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
twitch.tv/amazonalexa
@ AziFarjad
AziFarjad
Online training

108. Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Azi Farjad
Alexa Developer Evangelist
@ AziFarjad
AziFarjad