Google Developers Group and P3 digital services are organizing codelab & hackathon in Cluj-Napoca aimed to learn how to build Actions for the Google Assistant that are useful for your community – whether it’s a professional network, an interest group, or hometown. More on: https://www.p3-ds.com/blog/build-google-assistant-actions-codelabs-hackathon/

1. Building Conversational Experiences
with Actions on Google
Roxana Țîrlea
roxana.tirlea@ p3-group.com
Marius Mailat
m arius.m ailat@ p3-group.com
Cluj-Napoca Hackathon, 06.06.2018

3. Google Home/Mobile device — The surface to interact with
the Assistant.
The Google Assistant — A conversation between you and
Google that helps you get things done in your world.
Actions on Google — How developers can extend the
assistant (via Assistant apps)

4. Assistant App

5. I have some chicken, and also
canned tomatoes.
Well, it’s kind of cold outside, so I'd
like something to warm me up, like a
hot soup, and I want it fast.

6. How does it work?
Design Develop Discover

7. Assistant app
{ conversation
api request }
{ conversation
api response }
user input
app
response

8. “
Intent Matching — Match and categorize user utterances to
an intent.
Entity Extraction — Identify key words and phrases spoken
by the user.
@

10. Ok Google, talk
to Personal
Chef
Well, it’s kind of
cold outside, so
I’d like...
Sure, here’s
Personal Chef
What are you
in the mood
for?
What protein
would you like
to use?
Speech to Text
NLP
Know ledge
Graph
M L Ranking
User Profile
Speech to Text
Text to Speech
...
...
...
Trigger
W ELCOM E event
...
NLP:
Intent M atching
Entity Extraction

12. Live Demo
Roxana – TV Scheduler App

14. Intent
Triggered via a series of “user says” phrases or platform based events
Can collects entity values
Matched at every turn of conversation

15. Intent name
Name to use in Dialogflow console
Only used by the developer, not referenced in your code

16. Input and Output Contexts
You can require a context to be available before an Intent is enabled
Intent can set context to enable other Intents
Implement flow control between some Intents

17. Parameters
Values that we are trying to capture from the user phrases
Can specify a parameter name and a type of value
Values can be optional
Values can be a list of fixed values

18. Text response
Spoken when the Intent is complete
Embed entity values if desired
- “I found a recipe for $protein and $vegetable!”
Webhook can dynamically adjust this response

19. Developer entities

20. Specify follow up questions if a user doesn’t specify certain values
Read out in random order to make it more natural
Prompts

21. Fulfillment

22. Test Console
Test your agent by entering text or voice requests. Voice testing is available in
Chrome and Firefox browsers.

23. Actions Console
console.actions.google.com

24. g.co/actionswebsim

25. Server snippet code - PHP

26. const dialogflow = require('actions-on-google');
const app = dialogflow();
app.intent('Default Welcome Intent', conv => {
conv.ask('Welcome to number echo! Say a number.');
});
app.intent('Input Number', (conv, {num}) => {
// extract the num parameter as a local string variable
conv.close('You said ${num}.');
});
// The entry point to handle a http request
exports.yourAction = functions.http.onRequest(app);
Node.js Client library
https://github.com/actions-on-google/actions-on-google-nodejs

27. Where do I start?

28. Google Assistant SDK
developers.google.com/assistant/sdk

29. Google Assistant SDK
developers.google.com/assistant/sdk
Android Things
developer.android.com/things

30. g.co/dev/ActionsDesign

31. codelabs.developers.google.com

32. bit.ly/aog-tips | goo.gl/PMdr7N

33. Actions on Google Community Program
developers.google.com/actions/community
You are automatically invited to the program with publishing
your first Action and will receive a
Cool T Shirt + $200 Cloud Credits per month for a year
The Assistant team also recognizes milestones:
Traction Engagem ents Globalization

34. Actions on Google Developer Community
https://g.co/actionsdev
Actions on Google Developers
https://developers.google.com/actions
Actions on Google Twitter
https://twitter.com/actionsongoogle
Roxana Țîrlea
roxana.tirlea@ p3-group.com
Marius Mailat
m arius.m ailat@ p3-group.com

35. Questions?
Roxana Țîrlea
roxana.tirlea@ p3-group.com
Marius Mailat
m arius.m ailat@ p3-group.com