Delivered at GDG Cloud Melbourne (February) https://www.meetup.com/GDG-Cloud-Melbourne/events/258047647/

1. Conversation With Your Application
Using Dialogflow And CloudFunctions
Cliffano Subagio (@cliffano) - Shine Solutions

2. CLIFFANO SUBAGIO
Senior Consultant at Shine Solutions
Open Source Contributor
- Jenkins
- OpenAPI Generator
- AEM OpenCloud

3. Why Voice Matters?

4. Johannes Gutenberg in the 1400s

5. Michael Knight in the 1980s

6. Jean-Luc Picard in the 2300s

7. Me in 2011

8. Question:
Can we do better in 2019?

9. Dialogflow + CloudFunctions

10. Dialogflow
* Conversation interface
* Natural language processor
* Speech to text, text to speech
* Intents, entities, fulfilment
* Multi languages support
* Multi services integration

11. Cloud Functions
* You already know what it is
* Functions as a service
* Event driven
* Support node.js, Python, and Go

12. Architecture
Natural
language
processing
Voice
(and text)
input
Command
processing
and API calls

13. Convo
* node.js library for voice and text app
* Specification based
* Generates a Dialogflow agent
* Generates a CloudFunctions middleware

14. Greetings And Unknowns

15. Queries

16. A) Static Facts

17. THOMAS, PERCY, JAMES, GORDON, …
Static Facts - Thomas Children App

18. Static Facts - Thomas Children App

19. B) Freestyle-CloudFunctions

20. Freestyle-CloudFunctions Facts - Hacker News

21. Freestyle-CloudFunctions Facts - Hacker News

22. C) OpenAPI-CloudFunctions

23. OpenAPI-CloudFunctions Facts - Jenkins

24. OpenAPI-CloudFunctions - Data Flow
24
“Build job ABC”
“Job ABC has been
added to the queue”
{
“queryText”: “Build job ABC”,
“parameters”: {
“jobName”: “ABC”
},
“intent”: {
“displayName”: “build-job”
}
}
POST /job/ABC/build
200 OK
{
“fulfllmentText”: “Job ABC has been added to the queue”,
“payload”: { “google”: { “richResponse”: { “items”: [
“simpleResponse”: {
“textToSpeech”: “Job ABC has been added to the queue”,
“displayText”: “Job ABC has been added to the queue”,
}]}}}
}
{
“inputs": [
{
"intent": "actions.intent.TEXT",
"rawInputs": [
{
"inputType": "VOICE",
"query": “Build job ABC”
}
]}]}
"expectedInputs": [
{
"inputPrompt": {
"richInitialPrompt": {
"items": [ { "simpleResponse": {
"textToSpeech": “Job ABC has been added to the queue"
}
}]}}}]}

25. Anybody speaks German or Japanese?

26. Answer:
Yes. We can do better in 2019!

27. What’s Next?
1. Identity forwarding
2. HTTP basic auth on middleware
3. More services integration
4. More applications!

28. Voice matters.
Because not everyone can type.

29. Thank you.
Questions?

30. Links
• https://github.com/cliffano/convo
• https://github.com/cliffano/convo-generator
• https://github.com/cliffano/convo-node
• https://github.com/cliffano/convo-thomas
• https://github.com/cliffano/convo-hacker-news
• https://github.com/cliffano/convo-hacker-news-helper
• https://github.com/cliffano/convo-jenkins
• https://github.com/cliffano/convo-jenkins-helper
Repositories
• https://www.npmjs.com/package/generator-convo
• https://www.npmjs.com/package/convo-node
• https://www.npmjs.com/package/convo-hacker-news-helper
• https://www.npmjs.com/package/convo-jenkins-helper
Published Libraries