Talk given at DLD TLV 2016

1. Cognitive Services:
The Brains Behind Your Bot

2. About Me

3. The Bot
Revolution Is
Here
Image attribution https://www.linkedin.com/pulse/ai-chatbots-serious-business-alessio-monastra

4. Bots Are Not
New

5. What’s Changed
Machine Learning

6. Bots Are Only As Good As
Their Brains

7. What makes a Bot
Smart?

8. Speech
Language Understanding
Intelligent Service
Teach your apps to
understand commands
from your users
Linguistic Analysis
API
Easily parse complex text
with language analysis
Text Analytics API
Detect sentiment, key
phrases, topics, and language
from your text
Language

9. What makes a Bot
Smart?

10. Speech
Speech API
Convert speech to text and
back again, and understand
its intent
Speaker Recognition API
Give your app the ability to
know who's talking
Custom Recognition
Intelligent Service
Fine-tune speech
recognition for anyone,
anywhere

11. What makes a Bot
Smart?

12. LanguageKnowledge
Academic Knowledge
API
Explore relationships
among academic papers,
journals, and authors
Recommendations
API
Provide personalized
product recommendations
for your customers
Knowledge
Exploration Service
Add interactive search over
structured data to your
project

13. What makes a Bot
Smart?

14. KnowledgeSearch
Web Search
API
Connect powerful
search to your apps
Video Search
API
Trending videos,
detailed metadata,
and rich results
Autosuggest API
Give your app intelligent
autosuggest options for
searches
Image Search API
Bring advanced image
and metadata search
to your app
News Search
API
Link your users to
robust and timely
news searches

15. What makes a Bot
Smart?

16. Computer Vision API
Distill actionable
information from images
Video API
Analyze, edit, and
process videos within
your app
Face API
Detect, identify, analyze,
organize, and tag faces in
photos
Emotion API
Personalize experiences
with emotion recognition
Vision

17. Roll your own with REST APIs
Simple to add: just a few lines of code
required
Scalable
Integrate into the language and platform
of your choice
Breadth of offerings helps you find the
right API for your app
Built by experts in their field from
Quality documentation, sample code,
and community support
Easy Flexible Tested
GET A
KEY

18. Examples

19. Vision
Language
Understanding
Intelligent Service
Understand what your users are
saying
• Determines intent
• Detects entities
Seamless integration with Speech
Recognition
Learns over time
Use pre-built, world class models
from Bing and Cortana
Intent: TextToSpeech
Content: NewsHeadlines
Read me the
headlines
Play yesterday’s
Daily Show
Intent: PauseDevice
DateTime.duration: 5 Minutes
Pause for
5 minutes
Intent: PlayEpisode
Content: Daily Show
DateTime.date: T-1 Day

21. Sentiment Analysis

22. Real Time Crowd Insights

23. Computer Vision
https://www.microsoft.com/cognitive-services/en-us/computer-vision-api

24. Image Captioning – celebrity detection
https://www.captionbot.ai

25. Developer
Resources
Preview Pricing
https://www.microsoft.com/cognitive-services/en-us/pricing
Documentation
https://www.microsoft.com/cognitive-services/en-us/computer-vision-api/documentation
Client SDKs
https://github.com/Microsoft/ProjectOxford-ClientSDK
https://github.com/felixrieseberg/project-oxford (nodejs)
https://github.com/southwood/project-oxford-python
Example Code
https://github.com/jsturtevant/happy-image-tester-django
https://github.com/jsturtevant/happy-image-tester-nodejs
Join Our Community
https://stackoverflow.com/questions/tagged/microsoft-cognitive
https://social.msdn.microsoft.com/forums/azure/en-US/home?forum=mlapi
https://cognitive.uservoice.com/

26. Get started for free at
microsoft.com/Cognitive